Aritra Majumdar

Hi! I ran the code on a single GPU. I just commented out the distributed and fp16 portions and it's working fine.

> Hi, I am also trying to output the attention weight of llama3. Have you tried output Llama3 attention weight with itself? (for example, outputs = model.generate(tokens, output_attentions=True)) Hi @Icamd,...

> @bear96 Hi! I find this paper "Analyzing the Structure of Attention in a Transformer Language Model" mentioned something called " Null Attention", which said "attention focused on the first...

Same issue

> It was caused by the parameter `now`. > There are sevaral functions in the `GenerativeAgent` and `GenerativeAgentMemory` class that are needed to fill in the parameter `now`, such as...

What I cannot understand is, when I set `graphviz_bindir = '/usr/bin'` PyInstaller compiles successfully. But when I execute the application, it suddenly fails during pygraphviz steps. I could clearly see...

I tried adding them using `--add_binary` argument, but it still threw me this OS error. But I think that might be because I was adding the path to where graphviz...

I modified the hook-pygraphviz.py in this way: `graphviz_bindir = shutil.which('dot')` and used `pyinstaller --onefile --add-binary /usr/lib/x86_64-linux-gnu/graphviz:graphviz` and it works!

Unfortunately not. I am still getting the same problem.

Thank you! That helps a lot!