mattreyukIf you use AWS Sagemaker, Hugging Face have worked with them to create a TGI inference container…and one on using it to deploy Falcon: https://www.philschmid.de/sagemaker-falcon-llmAug 2, 20231Aug 2, 20231
mattreyukinBuilding IbottaMoving from Kube2Iam to KiamAt Ibotta, we chose kube2iam to assign AWS IAM Roles to containers running in our Kubernetes cluster. Lately, we’ve run into some issues…Jul 31, 20181Jul 31, 20181
