Large context data gathering and Structuring

Pushkar Yadav

June 11, 2024


Wake is a versatile tool designed to gather large context data and structure it for various purposes.

It operates by taking a user query and gathering search results, then recursively scraping the search results to extract inner content, typically gathering around 50K+ words in total. This provides ample data for making predictions. However, no existing model can handle this volume of data in one go while preparing structured output(models do but they hallucinate a lot, demo is using Google/Gemini-1.5-Pro). The output is then validated with Zod for structure and organized into a table.

This tool can be used to gain a deeper understanding of a topic (e.g., research paper data) by simply providing a query, and it will gather all the relevant data for you.

Availability: Not made this public yet. Stay tuned!, also attaching first release tweet below.

馃憟 Labs