stock data pipeline, Kafka+Cassandra+Spark+Node.js

Регулярные митапы и сообщество инноваторов в Гродно. Мы говорим о Web, IoT, JavaScript, Node.js, R & Big Data, Java, mobile & whatnot ;)

Enabling Data Analytics Workflows using Node-Local Storage

Float64Array.

Remove isolated nodes from an network igraph wps proc r. Keywords: sas sql join merge big data analytics macros oracle teradata mysql sas communities stackoverflow statistics artificial inteligence AI Python R Java Javascript WPS Matlab SPSS Scala Perl C C# Excel MS Access JSON graphics maps NLP natural language processing machine learning igraph DOSUBL DOW

Spark GraphX project based on social network datasets available from the SNAP repository. Analyzed Social Networks using GraphX. Ranked nodes based on the number of indegree and outdegree. Ranked the connected components on maximum nodes.

Apache Spark for: (a) structured matrix data: Matrix factorization, Alternating Least Squares (ALS) Algorithm for recommender systems with Apache Spark (b) unstructured text data: Sentiment analysis with Spark stream processing (c) structured graph/networks data: Network properties: centrality, articulation points, node degree distributions with Apache Sp

This Repo builds upon previous work to integrate Zookeeper, Schema Registry, Kafka, Spark, Yarn, Hive, Postrgres Metastore and three node Hadoop to provide an easily accessible Big Data Development environment

Auto push big data notification with Elasticsearch

Node.js server application that provides REST APIs to access a data repository ( second place @NTTS2019 Big data hackathon).

Um experimento simples para enriquecimento e visualização de dados de acesso em um site. Não é otimizado para grandes cargas, e precisa ser refatorado para entrar em produção.

Streamable uint32-prefixed frame decoder for node. Supports both little-endian and big-endian sizes. Size can include or exclude the 4 bytes of length itself. No O(N^2) problems on data trickling in. No dependencies.

Streamable uint32-prefixed frame decoder for node. Supports both little-endian and big-endian sizes. Size can include or exclude the 4 bytes of length itself. No O(N^2) problems on data trickling in. No dependencies.

Streaming is data processing for unbounded datasets (infinite datasets). Data is in motion. Cloud Pub/Sub connect applications and service through a messaging infrastructure. Pub/Sub is a global messaging queue, essentially a message bus (buffer). Message bus is reliable, has high throughput, and low latency. Pub/Sub is about capturing data and distributin

Math.js is an extensive math library for JavaScript and Node.js. It features a flexible expression parser with support for symbolic computation, comes with a large set of built-in functions and constants, and offers an integrated solution to work with different data types like numbers, big numbers, complex numbers, fractions, units, and matrices. Powerful an

This is the final project of my big data Bootcamp. I implemented a cluster(4 virtual machines) of hdfs (ha style) system and another yarn system(2 resource managers and 3 node manager with ha style). After building it, I wrote a topn java code and deployed it to my hadoop. This topn code is to find two days with the highest temperature in our dataset accordi

Portfolio - Full Time Projects Based on Various Tools - Programming Languages: Python3.5, PHP, Java, C, C# Databases: NoSQL (MongoDB), SQL, MySQL, Google Cloud Platform (MySQL), AWS(DynamoDB), SQLlite3, Memcached Couchbase (Server-side-cache). Operating Systems: Windows, Linux Ubuntu 16.04 Big Data Tools: Kafka. Technologies: JavaScript, Angular JS 7, jQue

Single node Hadoop cluster was used as framework for evaluation of dataset such as Youtube Data. - Map-reduce, Pig, Hive were used as a programming model for data analysis. - Data loading technique such as Sqoop was used for testing purposes.

MamaHippo Is an open source Jquery Single Page App (SPA) Framework written in MVC 4 and Visual Studio 11. Simple simple simple Quick code Lean Start-up Framework. It is meant to be a light wait focused implementation of all the best of bread tools in MV4 along with other necessities of a next gen web site\app. Things it will include. OpenID Social Site

In this project we implement algorithms in C++ to plot and analyze big data. We find the number of nodes in the graph, clustering coefficient, correlation between data points, characteristic path length, etc.