AI Aims For Perfect Coding And With Multiple Solutions
Meet pass@k
Published in
3 min readJun 18, 2023
And, so, the AI bot are fighting with each to be the one that gets everything right. So, no matter what problem we give them, they are competing to show that they can cope with your complex world of learning. The two core data sets used for the problems are HumanEval pass@1 accuracy and MBPP Pass@1.