Data Pipelines

Open-source data integration platform. 300+ connectors for moving data to warehouses and vector stores.

Workflow orchestration platform. Schedule and monitor complex data pipelines with Python DAGs.

Cloud platform for web scraping and automation. Pre-built scrapers for popular sites. Proxy and storage included.

Microsoft's OCR and document extraction. Forms, receipts, invoices with pre-built and custom models.

Headless browser infrastructure for AI agents. Run browser sessions at scale for web automation.

Web scraping and browser automation library. Handles anti-bot protections. TypeScript and Python.

Data orchestration platform. Asset-based pipelines with built-in testing and type checking.

SQL-based data transformation tool. Define models, test, and document your data pipeline in version-controlled SQL.

IBM's document conversion library. PDF, DOCX, PPTX to Markdown/JSON. OCR and table extraction built-in.

RAG framework by Mem0. Create AI apps over any data in minutes. Supports 20+ data source types.

Turn websites into LLM-ready data. Crawl, scrape, and convert web pages to clean Markdown for RAG.

Convert any URL to LLM-friendly text. Simple API: prefix URL with r.jina.ai. Free tier available.

LlamaIndex's document parser. Handles complex PDFs with tables, charts, and mixed layouts for RAG.

Fast PDF to Markdown converter. Handles complex layouts, tables, and equations. Local processing.

Universal document parser. Supports PDF, DOCX, PPTX, and more. Integrates with LangChain and LlamaIndex.

Modern workflow orchestration. Python-native, with retries, caching, and observability built-in.

Production-ready RAG engine. Ingestion, search, and generation in one system with knowledge graph support.

ETL for unstructured data. Extract and transform PDFs, images, HTML, and Office docs for LLM consumption.