Min-Fu YangThe write process of Spark Azure Blob WriterWe have a requirement to transfer Parquet data using Azure Blob Storage as medium between two Spark Applications. To achieve low latency…Oct 3, 2018Oct 3, 2018
Min-Fu Yang國外面試心得Booking.com/Line/Microsoft/Amazon最近遇到一些人想轉職軟體工程師,想說分享一些個人去年的面試經驗,讓大家了解一下軟體公司針對工程師是怎麼面試的,希望對大家有幫助。Aug 18, 20181Aug 18, 20181
Min-Fu YangAccessing multiple Azure Data Lake Storages in one Spark applicationTo accessing different ADL storage:Aug 16, 2018Aug 16, 2018
Min-Fu YangAbout Java ClassLoader: dynamic class generation in Apache Spark caseThe story begins with doing expression evaluation in Spark. My case is given some strings representing expressions & a set of variables…Aug 4, 2018Aug 4, 2018
Min-Fu YangInter-process communication in JavaThe story begins with comparing throughput of a service using multiple processes or multiple threads. In multi-processes test, to measure…Aug 1, 20181Aug 1, 20181