Scrape the host's danmu information in Douyu_TV live-show and do the corresponding statistic analysis by SPARK and some Big Data technologies.

--

Project developed during the Cognizant Cloud Data Engineer Bootcamp on the Digital Innovation One platform with the objective of extracting and counting words from a book in plain text format, displaying the most frequent word, through a python algorithm.

Labs for Big Data and Intelligent Analytics

Thanks to digitization, we often have access to large databases, consisting of various fields of information, ranging from numbers to texts and even boolean values. Such databases lend themselves especially well to machine learning, classification and big data analysis tasks. We are able to train classifiers, using already existing data and use them for pred

Temporal data processment package for Python, providing a scalable programming model created for data analysis, exploration and evaluation.

This repository involves a series of operations, including data cleaning, normalization, scaling, feature selection, and dimensionality reduction, to transform the data into a clean and organized format that is suitable for analysis big data using pandas and numpy libraries in python.

ECO 395m: Python, Databases, and Big Data

:computer::computer::computer: A commandline tool for analysis of big biological data sets for distributed HPC clusters.

Microsoft Big Data, Data Scientist, and AI

Big Data vs. complex physical models - a scalable nested sampling inference algorithm for many data sets

A Big Data Analytics VM for doing Data Science. It provides a huge kickstart to those working with the Big Data Analytics side of Data Science. Essentially, this project automates the creation of the Big Data Scientist's toolbox on a virtual machine (VM). In a few minutes one can begin working with a fully configured data science lab instead of performing

A task interface for Jupyter notebooks built on machine learning and big data