#MERN webstack #AWS EC2

Image for post
Image for post
Source

This is a quick demo of how to build a web app full-stack, from front to back, and make it interact with MongoDB Atlas.

# Whenever I start running my server on EC2, this link will work, or you will see a blank list :D
http://52.198.4.100/

Demo


專案簡介

近幾年「一頁式廣告」詐騙業者遍及臉書、入口網站或社群媒體等。一頁式廣告因將商品所有資訊,包括商品介紹、圖片、影像、下標等,都集中在一個頁面,方便快速,符合現在消費趨勢。RTH — Fraud:p — Phishing 一頁騙子詐騙查詢網站,提供使用者輸入可疑的網站地址進行查詢,確認是否為詐騙網站,也可進行舉報。

以下呈現的是前端設計,針對其他技術細節,例如演算法判定等等內容,可以參考我的技術分享影片連結

使用者平台前端設計

Image for post
Image for post
歡迎畫面

#Kafka #Zookeeper # Kafka manager #Logstash #Elasticsearch #Kibana #Python faker library

Image for post
Image for post
Giphy

Goal

Nowadays there are large amount of data generating from numerous sources, such as web services, digital media, sensor log data, etc., and only a small portion of it have been well managed or utilized to create value. This article may be a bit old but still worth a quick read — The Data Made Me Do It.

It has become more challenging than ever before to read large amount of data, process it and take action upon that data.

In this article, I’m trying to demonstrate:

  1. Generate mock user profile data in…


Image for post
Image for post

Goal

Recently I’m exploring how to deploy my app to different platform. Here’s how I build and deploy a Selfie App (built with Node.js) on Heroku. It’s great to see my app working on a cloud platform and allow me to share how it works to other people so much easier.

My app is quite simple, so maybe it wouldn’t make too much difference when it comes to using different platforms to deploy. This article is to showcase how easily we can deploy our app to AWS this sort of cloud service platform.


This is a showcase how I will package my previous Selfie App in a docker. Come check it out: https://hub.docker.com/r/ting11222001/selfieapp

Image for post
Image for post
Love it so much! My favorite animal has always been whales!

Goal

I’ve heard about docker for awhile, but today I’m going to package my Selfie App in a docker (you can read more about it here) and push it to docker hub (a place where we can share our app’s container images publicly or privately with a subscription plan), so other people can easily download it (i.e. pull the container image down) and run it on their machine. …


This is a data selfie app built with Express application framework in Node.js.

Objective

I’ve heard of Node.JS for while and been wanting to write a simple web app with JavaScript entirely.

Node allows us to write code on server-side within a runtime environment, so we can run our code in terminal directly. It also has plenty of great features e.g. it’s able to incorporate asynchronized interactions between client and server, comes with a package manager called npm (node package manager) which allows us to manage our dependencies much easier, etc.

It’s neat and somehow reminds me of flask in Python a lot, feeling the logic behind Express in Node.JS …


#Web Scraping (Python) #Database (MariaDB) #API (Django) #Visualization (echart)

Goal

Recently my other friends and I created an online dashboard to showcase what are the latest online/offline classes offered in Taiwan.

Here’s how it looks like:

Image for post
Image for post
http://lab.ntc.im:9110/

It was a 6 weeks on and off group project, and before this project we barely knew how to code. This is our milestone of learning how to code together. I’m so grateful that we finally made it!

Each one of us needed to scrape 2–3 websites with Python BeautifulSoup and Selenium, clean the data, wrap all the code into a testing python script. Some of us helped extra with setting up a VM server, designing the frontend look for this application, creating the entire django framework and the API, and finally deploying this web app using apache web server. …


Using Python to connect to Taiwan Government PM2.5 open data API, and schedule to update data in real time to MongoDB — Part 2

Goal

This time I’m using the same PM2.5 open data API (used in Part 1) to showcase how to refresh real time data into mongoDB for every 2 min (because it’s the time for the government’s portal to refresh its API). The strength of mongoDB is it’s simple to use, especially with JSON document format data. This makes connecting to open data much easier. …


Using Python to connect to Taiwan Government PM2.5 open data API and upload batch data to MongoDB — Part 1

Image for post
Image for post

Goal

MongoDB is the most popular NoSQL database in the world currently, and is quite simple to use.


Taiwan River Pollution Status Data Visualization with Elasticsearch and Kibana

Image for post
Image for post

Goal

I’m always fascinated by data analytics tools like the Elastic Stack, Splunk, etc. This time I will use the two components of the well-known Elastic Stack — Elasticsearch and Kibana — to showcase how we can utilize speedy store-search features of Elasticsearch and then use Kibana to give shape to our data.

I will create a Kibana dashboard to present river pollution status in Taiwan. Dashboard will cover:

  1. Overall data contains 117,883 rows, including 68 rivers and over 300 monitoring sites, from 2018 Jan — 2020 Jun.
  2. Select indices for each river. The most important index we’re looking at here is RPI (River Pollution Index, 河川污染指數) which is composed of multiple indices such as DO (水中溶氧量)、BOD5 (生化需氧量)、SS (懸浮固體)、NH3-N (氨氮). We can see over time how a river’s RPI is changing, and can also look at each specific related sub-indices as shown in the line chart. …

About

Li-Ting Liao

Hi there, are you also interested in building side projects? Check out my blog and let’s build together! https://medium.com/li-ting-liao-tiffany

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store