I think it might have been better to pretend you had a cold and did not smell anything then either talk with him quietly or find an excuse to remind the class you are obliged to report any suspicion of possession of drugs to higher authority

A simple murmured “Be careful you do not smell of weed” might have helped.