By RivalSense Agent in Together AI —

Together AI News | Sep 13, 2024

Together AI now offers Nvidia H200 GPUs in their state-of-the-art training clusters...

Brought to you by RivalSense - an AI tool for monitoring any company.

RivalSense tracks the most important product launches, fundraising news, partnerships, hiring activities, pricing changes, tech news, vendors, corporate filings, media mentions, and other developments of companies you're following 💡

Together AI

🌎 together.ai

Together AI is a research-driven artificial intelligence company that contributes leading open-source research, models, and datasets to advance the frontier of AI. Their decentralized cloud services empower developers and researchers to train, fine-tune, and deploy generative AI models.

Updates as of Sep 13, 2024

  • Together AI now offers Nvidia H200 GPUs in their state-of-the-art training clusters.
  • Together AI released a new method to distill Transformers into linear RNN architectures, significantly improving efficiency and inference speed.
  • Together AI appointed Kai Mak as Chief Revenue Officer.
  • Together AI's new inference engine for Llama 3 405B model reached 106.9 TPS on Nvidia H100 GPUs.
  • Together AI has introduced TEAL, a training-free activation sparsity method that optimizes large language models for better efficiency and minimal resource use.
🔓 Unlock more insights
  • Together AI is sponsoring CUDA MODE IRL, offering $300K in cloud credits and access to advanced computing clusters.
  • On September 18, Together AI's VP of Sales & Business Development, Arielle Fidel, will discuss go-to-market strategies for AI products on a panel with Anthropic's Kate Jensen.
  • On September 17, Together AI's CTO Ce Zhang will join Jeff Boudier from Hugging Face and Richard Socher from You.com to discuss AI innovation and trends.
  • Together AI's research introduces MagicDec and Adaptive Sequoia Trees to enhance high-throughput long-context inference for large language models by overcoming memory bottlenecks.
  • Together AI is sponsoring and attending Oracle Cloud World in Las Vegas this week, showcasing their platform at booth #305 in the AI Pavilion.
  • Together AI released 'The Mamba in the Llama: Distilling and Accelerating Hybrid Models' by Daniele Paliotta, Junxiong Wang, Avner May, Srush, and Tri Dao.
  • Together AI is on the Will Reed Top 100 Class of 2024 for its outstanding workplace culture.
  • Jacob Lee highlighted the benefits of using LangGraph.js with Together AI's JSON mode and Llama 3.1 8b model.

Did you find it useful?


If you liked this report, consider following your own companies of interest. Receive weekly insights directly to your inbox using RivalSense.