cerebros-core-algorithm-alpha
cerebros-core-algorithm-alpha copied to clipboard
The Cerebros package is an ultra-precise Neural Architecture Search (NAS) / AutoML that is intended to much more closely mimic biological neurons than conventional neural network architecture strategi...
Duplicative import: https://github.com/david-thrower/cerebros-core-algorithm-alpha/blob/main/phishing_email_detection_gpt2.py line 190, 191 ` from transformers import AutoTokenizer import tensorflow as tf `
Add the table in the PR and release for #172 to readme.md and a good explanation of how we scale in O(n) timing with sequence length to practically unlimited length.
# Complete this ... ## The code thus far ```python3 # Hard set these 2 params and do separate studies on each MINIMUM_LEVELS = 2 MAXIMUM_LEVELS = 2 NAMESPACE =...
Working from #156 ... ## It appears the positional embedding addition to the embedding model was a winner. GRUs alone deterriorated performance. LayerNorm dis as well. We have shown that...
1. Add a demo of our generative LLM. 2. Clean up the directory / folder structure.
Add the Jupyter notebook of the workflow after merge in #277 and test that it works from the main branch. [train_an_llm_with_cerebros(3).ipynb](https://github.com/user-attachments/files/23657223/train_an_llm_with_cerebros.3.ipynb)
## TLDR Branch 275 is functional and would be ready to merge, however, the Stage I-b is getting a less desirable Perplexity score. # Tasks ## From #275 try these...
# TLDR The root directory and other directories in this need to be de - cluttered. This may be confusing for users and could be down-rating the repo in the...
# Branch for demonstration of CICD workflows only, **do not merge** - A client desires a demo of the text generation workflow - This will trigger the workflow for demo...