Dev Percept

Learning Tech and Dev

Category: Big Data

LLM apps 0

Big Data / Data Science

A Brief History Of Technology Behind ChatGPT

Large Language models have gained huge popularity recently because of text generation and image generation models such as ChatGPT, Midjourney, Stable Diffusion, etc. These models are the results of the history of natural language processing and neural networks. Rule-based systems Let’s start from the 1960s when computers were gaining popularity in various industries and automation sectors. Language models marked their presence in the Computer...

380

Big Data / Data Science

Setting up Apache Hadoop cluster in AWS EC2

Apache Hadoop is a distributed software framework with which we can process large data sets across distributed clusters of computers. Hadoop scales up from a single machine to thousands of machines. Setting up the Apache Hadoop cluster in AWS EC2 is a relatively complicated task. We will follow some simple steps to set up the cluster quickly. There are four main modules in the...