Browsed by
Author: codethief

[Docker] React.js + Nginx

[Docker] React.js + Nginx

When you deploy your React.js application through Docker, you can deploy with Nginx. The basic principle is, first build a React.js application and move the generated files to “share/nginx/html” in the container. You are just replacing the default Nginx welcoming page to your React.js application. Now you just need to run Nginx. Please check the Docker file below. Check the sample project

Hadoop 101: Multi-node installation using AWS EC2

Hadoop 101: Multi-node installation using AWS EC2

In this post, we will build the multi-node Hadoop cluster using three EC2 instances ( one for master, two for slaves). (I will assume that you know how to use AWS. If you don’t, please check this link) To run Map-Reduce task properly, you need enough memory. Therefore, we will use t2.medium type instance. (If you are a student and need some free credit, check this link.) AWS EC2 t2.medium×3 (1 for a name node, 2 for data nodes) Ubuntu…

Read More Read More

[Docker-Compose] Django + PostgreSQL

[Docker-Compose] Django + PostgreSQL

When you need to launch multiple containers that work as a single application, it is difficult to manage with a single Dockerfile. That’s why we need to use “docker compose” so that we can manage our containers from a higher level. The application that we will test is a simple Django application. The database is PostgreSQL, and it will also be installed using Docker. Normally, it is not recommended to install the database using Docker. The database should be running…

Read More Read More

AWS EMR Tutorial – Part 1

AWS EMR Tutorial – Part 1

Hello! We have set up the Hadoop environment from the previous post. And YES! It IS a hassle unless you need your own tuned version of the environment. Therefore, I’ll introduce a more convenient way to use Hadoop environment from this post. We’ll test MRjob or PySpark using AWS EMR. In part 1 we’ll launch the EMR and use it very naively (static instances and using HDFS). From part 2 we’ll use EMR more correctly (?) (using AWS CLI and…

Read More Read More

How to install Flask in Ubuntu 18.04

How to install Flask in Ubuntu 18.04

Ubuntu version : 18.04Python version: 3.6.7 Let’s get started from Ubuntu. If you are in ubuntu server and type below command you will see the version of your current python installation. In my case, it was Python 3.6.9. Now we need to install ‘virtualenv’ module.(There are several approaches that we can set a virtual environment for python, but it seems like this one is recommended these days.) Then, we make our project directory. In side the project directory, we need…

Read More Read More

Django 301 redirect problem with React

Django 301 redirect problem with React

The answer is: ‘/’ Sometimes when you change your client-side code, and suddenly you experience a 301 redirect response from your server-side. In my case, I was using Django as a serverside and use ReactJS as a client-side. The API was implemented in a RESTful style. Most of the cases, the reason was I forgot to end with ‘/’ in my request URL. (Good) https://api.example.com/api/100/ (Bad) https://api.example.com/api/100 I haven’t really investigated what is behind this rule but, don’t panic and…

Read More Read More

Sending simultaneous requests using Python

Sending simultaneous requests using Python

Python is a perfect programming language unless you have to deal with asynchronous action. Many programmers using Javascript complain about ‘callback hell’. Still, people become grateful when they have to deal with asynchronous action (simultaneous, parallel, concurrent, etc.). Recently I needed to send several requests at the same time, instead of waiting for the previous request to finish. Moreover, all responses should be collected as one variable. 1. Ordinary request If we call 10 requests sequentially, it took 11.285 seconds….

Read More Read More