Damien
Damien
This is about running LLMs locally on Apple Silicone. Core ML is a framework that can redistribute workload across CPU, GPU & Nural Engine (ANE). ANE is available on all...
Hi, yes. @ntindle This is about running LLMs locally on Apple Silicone. Core ML is a framework that can redistribute workload across CPU, GPU & Nural Engine (ANE). ANE is...
I mean, it was a general overview; you don't have to package models; you just need to be able to use CoreML packaged models. Work in progress on CoreML implementation...
https://appleinsider.com/articles/24/05/07/secret-apple-project-acdc-to-pioneer-ai-chips-for-data-centers > Under the internal name "Project ACDC," Apple is developing [Apple Silicon](https://appleinsider.com/inside/apple-silicon) designed specifically for server farms dedicated to AI processing. The company aims to optimize AI applications within...
Are you guys using llama.cpp in AutoGPT?
You could build a graph based on helm chart installed or using GitOps tools such as ArgoCD or FluxCD. FYI @kimchaeri
GRAG = Graph RAG great article explaining how Grapg Knowledge DB can improve quality of RAG https://medium.com/towards-data-science/text-to-knowledge-graph-made-easy-with-graph-maker-f3f890c0dbe8
Hope Knowledge Graph Data Bases such as Neo4j, FalkorDB, Nebula Graph can be integrated with Flowise LangChain has it for a while now: https://python.langchain.com/v0.2/docs/integrations/graphs/neo4j_cypher/
Note, Neo4J can work as both: Vector Database, and Knowledge Graph Data Bases that is using Cypher queries (similar to SQL but for KG).
https://docs.llamaindex.ai/en/stable/api_reference/storage/graph_stores/neo4j/