awesome-ai-dev-platform-opensource
awesome-ai-dev-platform-opensource copied to clipboard
An On-Chain Open-Source Platform for Rapid AI Model Productization Using Decentralized Resources with Flexibility and Scalability
Breaking: AIxBlock transitions to open-source. Please follow us for more updates. Here is a brief overview of our project.
AIxBlock
The first unified platform for end-to-end Al development and workflow automation β MCP compatible
π What is AIxBlock?
AIxBlock is the first unified platform for end-to-end AI development and workflow automation β modular, interconnected, and built for custom AI. Powered by MCP and decentralized resources, it lets you build & deploy custom models, automate AI workflows, and monetize every step. Modular, interconnected, and built for custom AI, it's designed for AI engineers and dev teams who want everything in one stack:
- Data Engine: Unified pipeline for data crawling, curation, and automated large-scale labeling with humans in the loop, supporting any kinds of models including multimodal.
- Low-Code AI Workflow Automation: Create and manage any AI workflow automation. You can also train/fine-tune AI models directly on workflows
- Distributed Parallel Training (with MoE Support): Train AI models across decentralized compute nodes with auto-configuration, MoE model support.
- Decentralized Compute Marketplace: Access a global pool of underutilized GPU resources at zero margin, enabling cost-effective, scalable AI training.
- Decentralized Model Marketplace: Buy, sell, and reuse fine-tuned models within a peer-powered ecosystem β accelerating innovation and monetization.
- Decentralized automation workflow templates Pool: AIxBlock lets you monetize your AI automation workflowsβwhether they're built on AIxBlock, Make.com, Zapier, or n8n.
- MCP Integration Layer: Easily connect AIxBlockβs AI ecosystem to third-party environments and dev platforms that support MCP β enabling flexible workflows across apps and IDEs.
π How Does It Work ?
[Curate Data] β [Label] β [Train] β [Deploy] β [Use/Automate] β [Monetize]
β Bring Your Data or Use our Crawler
- Collect, curate, and label structured or unstructured data β all in one place.
- Use our built-in Data Crawler or pull from data from: local files, your storage, GitHub, Hugging Face, Roboflow, Kaggle, and any other apps
- Tap into a global workforce of 170,000+ labelers Coming soon: Decentralized data pool
β‘ Label It Your Way
- Define your own input/output dataset formats. Customize your labeling UI including multimodal.
- Support all data format, including multimodals (Images | Text | Audio | Video | Multimodal).
β’ Train at Scale
- Train your custom models at scale β without setting up your own infrastructure.
- Distributed Data Parallel (DDP) built-in
- Built in MLOps tools
- Auto training & active learning optimization
- Connect to Hugging Face, Git, Roboflow, S3, etc β pull and store models easily
β£ Use Decentralized Resources
- On-Demand High-End Compute at up to 90% cheaper
- Global Labeling Workforce across 100+ Countries
- Pre-trained AI/ML Models Marketplace
- AI Dataset Pool (soon) β€ Deploy models
- Test models in a built-in real-time demo environment & Deploy them using decentralized high performance compute
β₯ Automate Workflows
- Build AI automation workflows with your custom models:
- Use our our built-in AI automation workflow builder to connect models to APIs, CRMs, and any apps/environment of your choice
- Use your own models or rent from the marketplace β full flexibility, zero vendor lock-in
β¦ Monetize It All
- Turn every part of your workflow into income.
- Monetize your models
- Rent out idle GPU compute
- Offer services (labeling, fine-tuning, automation)
- Monetize AI automation workflow templates no matter where did you build it (n8n, make.com, zapier, etc)
- (Coming soon) Contribute datasets
π οΈ Getting Started
-
Requirements:
- Python 3.10
- NVM
- PostgreSQL
- Redis
- Nodejs 18.19.0
-
Clone the Repository:
git clone https://github.com/<your-org>/aixblock.git cd aixblock -
Install Dependencies:
python -m venv venv source venv/bin/activate # On macOS/Linux venv\Scripts\activate # On WindowsInstall dependencies from
requirements.txt:pip install -r requirements.txtCopy the example environment file and generate a random secret key:
cp .env.example .env # Generate a random SECRET_KEY and replace the placeholder in .env sed -i '' -e "/^SECRET_KEY=/s/=.*/=`openssl rand -hex 32`/" .env > /dev/null 2>&1Install pnpm
npm install -g pnpm@latest-10Set max_user_watcher
echo fs.inotify.max_user_watches=524288 | sudo tee -a /etc/sysctl.conf && sudo sysctl -p -
Workflow:
Install dependencies for the first time
make install-workflowRun workflow
make workflow-engine # 1st terminal make workflow-backend # 2nd terminal make workflow-frontend # 3rd terminal -
Run the Platform:
Setup project for the first time
make setupRun the project - open two terminals
make worker # 1st terminal make run # 2nd terminalNote: Always run the workflow before the platform to avoid database lock.
π€ How to Contribute
- Check the Issues for open tasks.
- Fork the repository and create your feature branch:
git checkout -b feature/your-feature-name - Submit a Pull Request with detailed notes.
π Community Contribution Rewards
- Earn points for every meaningful contribution.
- Be part of our long-term profit-sharing ecosystem for every single contribution.
π¬ Join the Community
- Discord: Join Us
- Twitter: Follow Us
- Telegram: Join the Discussion
- LinkedIn: Follow Us
- YouTube: Watch Our Channel
- Website: https://aixblock.io
- Platform: https://app.aixblock.io
- Huggingface: https://huggingface.co/AIxBlock
π Keywords
ai, llm, decentralized-ai, generative-ai, asr, computer-vision, nlp, privacy, security, open-source, distributed-computing, ddp, distributed-training, distributed-data-parrallel, self-hosted-ai platform, decentralized-dataset-pool, self-hosted-labeling-tool, self-hosted-ai-deployment, fine-tuning, ai-development-platform, ai-production-platform
β Show Your Support
Give this repository a β and share it with your network to help grow the AIxBlock community.
Thank you our below contributors:
TESLA-SATI π |
eMKayRao π‘οΈ |
0XZAMAJ π‘οΈ |
pravinkumar-exe π‘οΈ |
priyanshukumar397 π‘οΈ |
0xygyn-X π‘οΈ |
Godswill Idolor π‘οΈ |
s.0wn π‘οΈ |
FCGitUser π‘οΈ |
Ryan E. π‘οΈ |
AbhishekKumar9430 π‘οΈ |
proxypentest π‘οΈ |