Israel HerraizinGoogle Cloud - CommunityApache Beam schemas and Cloud Dataflow updatesUse @SchemaFieldNumber with your Java pipelines in Apache Beam to make sure that schemas are always backwards compatibleFeb 9Feb 9
Israel HerraizinGoogle Cloud - CommunityWrite SQL with natural language using Vertex AI and BigQueryUse Vertex AI, PaLM, Codey and BigQuery, with langchain, to create a chatbot with memory that answers to questions using BigQuery.Nov 26, 20232Nov 26, 20232
Israel HerraizinGoogle Cloud - CommunityLangchain: how to return several outputs in the same chain?Use all the information in a chain to pass several fields to the next chain.Nov 24, 20231Nov 24, 20231
Israel HerraizinGoogle Cloud - CommunityHow to get a Beam schema from a BigQuery schema JSON fileLearn how to write Beam pipelines with dynamic schemas using BigQuery JSON schema files.Aug 22, 2022Aug 22, 2022
Israel HerraizinGoogle Cloud - CommunityUsing Terraform to trigger Dataflow?Here is how to pass any Dataflow runner option to your job using Flex TemplatesJan 25, 2021Jan 25, 2021
Israel HerraizinGoogle Cloud - CommunityProfiling Apache Beam Python pipelinesOften the first version of our Apache Beam pipelines do not perform as well as we would like, and sometimes it is not so obvious to find…Nov 30, 2020Nov 30, 2020
Israel HerraizinGoogle Cloud - CommunityBackporting the latest Google Cloud operators in Apache Airflow and Cloud ComposerEnjoy the latest version of the Google Cloud operators with Cloud Composer: backport the operators from Airflow 2.x without upgradingNov 20, 2020Nov 20, 2020
Israel HerraizinTowards Data ScienceDependencies between DAGs in Apache AirflowIn Apache Airflow, we can create dependencies between different DAGs, and run downstream DAGs that depend on external/upstream DAGs.Jul 1, 20201Jul 1, 20201
Israel HerraizinGoogle Cloud - CommunityReading NULLABLE fields with BigQueryIO in Apache BeamHow to read NULLABLE fields from BigQuery with Apache Beam, using GenericRecord values (that is, encoded in Avro).Jun 21, 2020Jun 21, 2020
Israel HerraizinGoogle Cloud - CommunityReading NUMERIC fields with BigQueryIO in Apache BeamTo read a NUMERIC from BigQuery in Beam you need to extract the scale of the number from the schema, and use that to construct a…Jun 15, 2020Jun 15, 2020