Dataset curation is often one of the lengthiest parts of any project for me. But, like any output, it can make or break the end product, in this case the safety of an AI product.
Yes indeed. I find dataset curation the most important component in AI evaluation in many projects. It is like giving exams to students, and dataset curation is designing the actual tests. If it is too easy or irrelevant, then the test scores mean nothing.
Thanks for your post - There's maybe more to AI safety than meets the eye - Having discovered a major technical issue - these are some additional thoughts to those above - about how AI regulation needs mechanism for people to register discovered issues as we do in medical devices or the aeronautical industry where safety is a prime issue.
Hey Kevin, really enjoyed your post on AI safety — thanks for sharing these important insights.
I’m not surprised that those of us working in high-stakes fields like medicine and education are among the first to advocate strongly for AI safety. Too often, tech companies focus heavily on response quality metrics while giving insufficient attention to safety-related measures.
It can be frustrating that investments in AI safety aren’t where they need to be yet, but I truly believe awareness will grow, and the urgency to prioritize safety will become undeniable. Until then, let’s keep pushing this topic forward and making sure it stays on the agenda.
Hey Kevin, really enjoyed your post on AI safety — thanks for sharing these important insights.
I’m not surprised that those of us working in high-stakes fields like medicine and education are among the first to advocate strongly for AI safety. Too often, tech companies focus heavily on response quality metrics while giving insufficient attention to safety-related measures.
It can be frustrating that investments in AI safety aren’t where they need to be yet, but I truly believe awareness will grow, and the urgency to prioritize safety will become undeniable. Until then, let’s keep pushing this topic forward and making sure it stays on the agenda.
Dataset curation is often one of the lengthiest parts of any project for me. But, like any output, it can make or break the end product, in this case the safety of an AI product.
Yes indeed. I find dataset curation the most important component in AI evaluation in many projects. It is like giving exams to students, and dataset curation is designing the actual tests. If it is too easy or irrelevant, then the test scores mean nothing.
Thanks for your post - There's maybe more to AI safety than meets the eye - Having discovered a major technical issue - these are some additional thoughts to those above - about how AI regulation needs mechanism for people to register discovered issues as we do in medical devices or the aeronautical industry where safety is a prime issue.
https://kevinhaylett.substack.com/p/there-is-no-ai-safety
Hey Kevin, really enjoyed your post on AI safety — thanks for sharing these important insights.
I’m not surprised that those of us working in high-stakes fields like medicine and education are among the first to advocate strongly for AI safety. Too often, tech companies focus heavily on response quality metrics while giving insufficient attention to safety-related measures.
It can be frustrating that investments in AI safety aren’t where they need to be yet, but I truly believe awareness will grow, and the urgency to prioritize safety will become undeniable. Until then, let’s keep pushing this topic forward and making sure it stays on the agenda.
Hey Kevin, really enjoyed your post on AI safety — thanks for sharing these important insights.
I’m not surprised that those of us working in high-stakes fields like medicine and education are among the first to advocate strongly for AI safety. Too often, tech companies focus heavily on response quality metrics while giving insufficient attention to safety-related measures.
It can be frustrating that investments in AI safety aren’t where they need to be yet, but I truly believe awareness will grow, and the urgency to prioritize safety will become undeniable. Until then, let’s keep pushing this topic forward and making sure it stays on the agenda.