… According to a Goldman Sachs Research report, an OpenAI ChatGPT query needs almost 10 times the electricity to process as a Google search does and the energy demand emanating from AI jobs promises to grow. …
… ChatGPT 4 was estimated to have over a trillion at last count. At the other end of the pipeline, inference – often carried at real-time speeds – makes latency and throughput equally as critical. …
… ObjectScale also will support S3 over RDMA for 230 percent higher throughput and 80 percent lower latency than traditional S3. …
… It’s part of emerging edge AI trend to better AI-enable Internet of Things IoT and other edge devices to reduce latency and save money. …