also for the environment, I would think. It saves a ton of useless traffic
GPT is worse and it’s not even close.
My PC can serve up a hundred requests per second running an HTTP server with a connected database with 200W power usage
It takes that same computer 30-60s to return a response from a 13B parameter model (WAY less power usage than GPT), while using 400W of power thanks to the GPU
Napkin math, the AI response uses about 10,000x more electricity
One time, chatGPT gave me a code in Python to use a specific Python library. When I said I was coding in Ruby on Rails, it converted the Python code to Ruby syntax.
Well, having a crawler search through all that garbage, ads, questions, wrong answers. And converting that to facts or condensed information…
Just makes so much more sense, also for the environment, I would think. It saves a ton of useless traffic.
But the “AI” part may be problematic.
GPT is worse and it’s not even close.
My PC can serve up a hundred requests per second running an HTTP server with a connected database with 200W power usage
It takes that same computer 30-60s to return a response from a 13B parameter model (WAY less power usage than GPT), while using 400W of power thanks to the GPU
Napkin math, the AI response uses about 10,000x more electricity
Yeah, the bullshit generator part is not useful.
One time, chatGPT gave me a code in Python to use a specific Python library. When I said I was coding in Ruby on Rails, it converted the Python code to Ruby syntax.
It literally made up a solution.