JAWAHARLAL NEHRU TECHNOLOGICAL UNIVERSITY HYDERABAD

MINING MASSIVE DATASETS

M.Tech I Year I Semester (R22)

Prerequisites:

  • 1. Students should be familiar with Data mining, algorithms, basic probability theory and Discrete math.

Course Objectives:

  • 1. This course will cover practical algorithms for solving key problems in mining of massive datasets.
  • 2. This course focuses on parallel algorithmic techniques that are used for large datasets.
  • 3. This course will cover stream processing algorithms for data streams that arrive constantly, page ranking algorithms for web search, and online advertisement systems that are studied in detail.

Course Outcomes:

  • 1. Handle massive data using MapReduce.
  • 2. Develop and implement algorithms for massive data sets and methodologies in the context of data mining.
  • 3. Understand the algorithms for extracting models and information from large datasets
  • 4. Develop recommendation systems.
  • 5. Gain experience in matching various algorithms for particular classes of problems.

UNIT - I

Data Mining-Introduction-Definition of Data Mining-Statistical Limits on Data Mining, MapReduce and the New Software Stack-Distributed File Systems, MapReduce, Algorithms Using MapReduce.

UNIT - II

Similarity Search: Finding Similar Items-Applications of Near-Neighbor Search, Shingling of Documents, Similarity-Preserving Summaries of Sets, Distance Measures. Streaming Data: Mining Data Streams-The Stream Data Model , Sampling Data in a Stream, Filtering Streams.

UNIT - III

Link Analysis-PageRank, Efficient Computation of PageRank, Link Spam Frequent Itemsets-Handling Larger Datasets in Main Memory, Limited-Pass Algorithms, Counting Frequent Items in a Stream. Clustering-The CURE Algorithm, Clustering in Non-Euclidean Spaces, Clustering for Streams and Parallelism.

UNIT - IV

Advertising on the Web-Issues in On-Line Advertising, On-Line Algorithms, The Matching Problem, The Adwords Problem, Adwords Implementation. Recommendation Systems-A Model for Recommendation Systems, Content-Based Recommendations, Collaborative Filtering, Dimensionality Reduction, The NetFlix Challenge.

UNIT - V

Mining Social-Network Graphs-Social Networks as Graphs, Clustering of Social-Network Graphs, Partitioning of Graphs, Simrank, Counting Triangles.

TEXT BOOK:

  • 1. Jure Leskovec, Anand Rajaraman, Jeff Ullman, Mining of Massive Datasets, 3rd Edition.

REFERENCES:

  • 1. Jiawei Han & Micheline Kamber , Data Mining – Concepts and Techniques 3rd Edition Elsevier.
  • 2. Margaret H Dunham, Data Mining Introductory and Advanced topics, PEA.
  • 3. Ian H. Witten and Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann.

Loading Question Papers

Fetching data from database...