Dspy for multineedle in a haystack

[joshpopelka20]

I'm trying to use llama 3.1 70B to do "multi-needle in a haystack" search. Basically, I'm asking the model to use a text and search through a list of terms; finding all terms in the given text. My current prompt isn't working and I didn't see any examples for "multi-needle in a haystack". Has something like this or something similar been tried with dspy?

I've done instruction fine-tuning with the 8B model, but it didn't work. Next step is the 70B model, but I'm starting to think I need some prompt engineering to figure it out. This project seems like a good start.

Any help would be much appreciated!