Cognitive Reader is a small extension I built using Groq Cloud and llama 3 . The idea is to allow users to extract concise information from a page without switching tabs by simply selecting the text. There's more the summarizing sometimes text context is required to be understood in a better way, so it's also one use case.
Currently, it processes about 1250 tokens per second with the Llama-3-8B model hosted on Groq Cloud's LPU inference engine. If you're reading this in the future (even a few months from now, given the rapid pace of tech advancements), this speed and functionality might be most normal thing out there 馃槀.
What's Next? Making a Internet aware functionality into it to be more context aware while reading something. Also, guess what's correct info and what's not.
Availability: Browser extension not public yet. Stay tuned!
Made a little extension for a lazy person like me to consume info pretty fast. God Speed with @GroqInc That's dev version running locally, on the server (@vercel edge) will be much faster, and extra capabilities Tweets from @rauchg @nievesfabian13