Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Not for inference, right?


correct - h100 can do like 100 tokens per second on a gpt4 like model, but you'd need to account for regular fine-tuning to accurately compare to a person, hence 4 or so. of course the whole comparison is inane since computers and humans are obviously so different ha...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: