Aleph Alpha | Latest News & Updates - Nov 01, 2024 Release
Aleph Alpha introduced u-μP, a new scheme combining Maximal Update Parametrization with Unit Scaling, to optimize model training efficiency and performance...
Brought to you by RivalSense - an AI tool for monitoring any company.
RivalSense tracks the most important product launches, fundraising news, partnerships, hiring activities, pricing changes, tech news, vendors, corporate filings, media mentions, and other developments of companies you're following 💡
Aleph Alpha
🌎 aleph-alpha.comAleph Alpha is a German AI research and application company specializing in developing large-scale AI models for language, image data, and strategy. They focus on contributing to Europe's digital sovereignty by providing cutting-edge AI solutions for enterprises and governments.
Aleph Alpha - Latest News and Updates
- Aleph Alpha introduced u-μP, a new scheme combining Maximal Update Parametrization with Unit Scaling, to optimize model training efficiency and performance.
- Aleph Alpha introduced Unit-Scaled Maximal Update Parametrization (u-μP) in partnership with GCResearchTeam to enhance training stability and hyperparameter transfer across model sizes.
- Aleph Alpha collaborated with the Google Research Team to improve µP for out-of-the-box FP8 training of LLMs.
- Aleph Alpha released new resources including a model on Huggingface, a paper on arXiv, and a codebase on GitHub.
- Thorsten Busch has started a new position as Senior Support Engineer at Aleph Alpha.
- Eva Dröghoff is leaving Aleph Alpha as a Legal Trainee in Germany to join Bundesministerium für Wirtschaft und Klimaschutz as a Legal Intern.
Sign up to receive regular updates
If you liked the insights, consider following your own companies of interest. Receive weekly insights directly to your inbox using RivalSense.