tech, startups, internet

Counting the OOOMs.

Hard not to be awed reading this. Teaser: “AGI by 2027 is strikingly plausible. GPT-2 to GPT-4 took us from ~preschooler to ~smart high-schooler abilities in 4 years. Tracing trendlines in compute (~0.5 orders of magnitude or OOMs/year), algorithmic efficiencies […]

tech, startups, internet

Counting the OOOMs.

Hard not to be awed reading this. Teaser: “AGI by 2027 is strikingly plausible. GPT-2 to GPT-4 took us from ~preschooler to ~smart high-schooler abilities in 4 years. Tracing trendlines in compute (~0.5 orders of magnitude or OOMs/year), algorithmic efficiencies […]

tech, startups, internet

Geeks think GPT-4 is getting worse.

From the Hacker News forum: “Ask HN: Is it just me or GPT-4’s quality has significantly deteriorated lately?” My anecdotal experience aligns with this. I’ve been especially disappointed using it for code the past month or so. ~ learn more

tech, startups, internet

Introducing Gorilla.

This seems like it might be something. “Gorilla is a LLM that can provide the appropriate API calls. It is trained on three massive machine learning hub datasets: Torch Hub, TensorFlow Hub and HuggingFace. … Zero-shot Gorilla outperforms GPT-4, Chat-GPT […]

tech, startups, internet

GPT-4 is a reasoning engine.

There was once a well reasoned argument for life on mars. But it was built upon faulty information, namely a visual artifact from low-resolution photos. Similarly the large language model draws reasoned conclusions as it best can, but is hampered […]