Succeed in AI Engineering roles
We haven't written up this one. Daily Dose of DS has the full story — the link below goes straight to it.
More in AI
Hong Kong police launch AI-powered national security platform for school pupils
Hong Kong police have launched an artificial intelligence-powered national security education platform for pupils. The NSmarties AI Interactive Platform was officially launched last week at a ceremony at Precious Blood Primary School in Ap Lei Chau, with about 700 pupils attending, police said in a social media post.
Hong Kong police launch AI-powered national security platform for school pupils
Hong Kong police have launched an artificial intelligence-powered national security education platform for pupils. The NSmarties AI Interactive Platform was officially launched last week at a ceremony at Precious Blood Primary School in Ap Lei Chau, with about 700 pupils attending, police said in a social media post.
An 80GB H100, and only 3B of the model could keep up with conversation
📝 Originally published (in Japanese) at forge.workstyle.tech . I used to think that 80 GB of VRAM would be enough to chat with a large model.
- An 80GB H100 GPU insufficient for full 35B model
- 3B-parameter model used for each token generation
- MoE mechanism enabled 35B model with 3B weights per token