Firecrawl | Latest News & Updates - Nov 06, 2024 Release

Firecrawl has released Firecrawl Simple, a self-hosting optimized version without billing logic and AI features, and is seeking contributors for paid part-time maintainer roles...


Brought to you by RivalSense - an AI tool for monitoring any company.

RivalSense tracks the most important product launches, fundraising news, partnerships, hiring activities, pricing changes, tech news, vendors, corporate filings, media mentions, and other developments of companies you're following 💡


Firecrawl

🌎 firecrawl.dev

Firecrawl is a technology company that provides an API service designed to crawl websites and convert their content into clean markdown or structured data. It is particularly aimed at LLM engineers, data scientists, AI researchers, and developers who need to extract and utilize web data for training machine learning models. The platform supports various modes of operation, including scraping individual pages or crawling entire websites, making it a versatile tool for data extraction.


Firecrawl - Latest News and Updates

  • Firecrawl has released Firecrawl Simple, a self-hosting optimized version without billing logic and AI features, and is seeking contributors for paid part-time maintainer roles.
  • Firecrawl rebuilt their Markdown parser from scratch, achieving up to 4x faster parsing speeds and improved reliability, as announced on November 5.
  • On November 2, 2024, Firecrawl introduced mobile device emulation for scraping and screenshots, allowing users to interact with sites as if from a mobile device.
  • Firecrawl completed Launch Week II on November 5, introducing new features like Batch Scraping and Credit Packs.
  • Firecrawl collaborated with OpenAI to build the new Predicted Outputs feature for GPT-4o, enhancing its speed and SEO capabilities.
  • Firecrawl-Simple is a stable fork of Firecrawl optimized for self-hosting, created due to the closed-source nature of Fire-engine and the need for a version without SaaS and AI dependencies.
  • Firecrawl has launched KaibanJS v0.9.0, featuring a new tool for professional web scraping that converts websites to LLM-ready content.
  • Firecrawl launched two new actions, Scrape and Wait for Selector, to enhance webpage task execution before content scraping.
  • Firecrawl announced advanced iframe scraping support, handling nested iframes, dynamically loaded content, and cross-origin frames.
  • Firecrawl is using Anthropic's new Haiku to crawl websites faster and outperform GPT-4o in some benchmarks.

Sign up to receive regular updates


If you liked the insights, consider following your own companies of interest. Receive weekly insights directly to your inbox using RivalSense.