Collect data from databases of various social program applications of the

middle-east government

● Sources: Attendance, Marriage Fund, Social Security Fund, Security Operation,

Network Operation

● Plot of latecomers, vacations, geolocations, marriage fund applications, refunds, etc.

● Machine Learning: Prediction on budget, attendance, Clustering of marriage fund applicants based on feature extraction

Big Data Analytics Stack

● Airflow, Argo
● Sqoop, Kafka, Spark
● HDFS, Minio, SeaweedFS
● Hive
● Mongodb, Cassandra, Aerospike, ElasticSearch, PrestoDB, Druid
● Kubernetes, Docker
● Superset, Metabase
● PowerBI, Tableau

Machine Learning

● Descriptive and Predictive analysis of structured data - Risk analysis, Fraud detection,
Security incident detection
● Computer vision - Object detection based signature detection in scanned documents.
Image-based document classification and extraction, License-plate detection
● NLP - Named entity recognition, Sequence to Sequence modelling, Sentiment analysis,
Text-based classification

Technology Stack

● TensorFlow, KubeFlow, PyTorch, AutoML, MLlib, Dask, Cloud ML, BERT
● Amazon, Google, Microsoft, Linode, Paperspace