You will get familiar with the course, the instructor, your classmates, and the learning environment. The overview of the course will also be covered during the same session.

Activities

• Reading: Syllabus
• Join NTHU ilms System
• Take Orientation Quiz before 2017/9/25

"Database community focuses on information storage, organization, management, and access and it is driven by new applications" cited from the Lowell Database Research Self-Assessment Report. In this session, we will discuss how our society forms/formed the modern database management systems. We will also have an overview for basic database concepts.

Activities

• Reading: Jim Gray. "Evolution of Data Management" Computer v29 n10 (October 1996):38-46
• Reading: William Kent, "A Simple Guide to Five Normal Forms in Relational Database Theory", Communications of the ACM 26(2), Feb. 1983, 120-125
• Reading: Douglas Comer. "Ubiquitous B-Tree." ACM Computing Surveys (CSUR), Vol. 11, Issue 2, June 1979, Pages 121-137
• Reading: Justin Zobel et al. "An Efficient Indexing Technique for Full-Text Database Systems." Proc. of the 18th VLDB conference, Canada, 1992, Pages 352 - 362
• Reading: Matthias Jarke et al. "Query Optimization in Database Systems." ACM Computing Surveys (CSUR), Vol. 16 , Issue 2, June 1984, Pages 111-152
• Reading: Jim Gray. "The Transaction Concept: Virtues And Limitations." In Proc. of the 7th VLDB conference, Cannes, 1981, pages 144-154
• Reading: Peter Chen. "English Sentence Structure and Entity-Relationship Diagram." Information Sciences, Vol. 1, No. 1, Elsevier, May 1983, Pages 127-149
• Reading: Peter Chen. "A Preliminary Framework for Entity-Relationship Models." Entity-Relationship Approach to Information Modeling and Analysis, (edited by P. Chen), North-Holland (Elsevier), 1983, Pages 19 - 28

Related Videos (IIT Styles)

• Lec#01-Introduction to DBMS by Prof. Partha Pratim Chakrabarti (IIT KGP)
• Lec#02-Introduction to DBMS by Prof. Partha Pratim Chakrabarti (IIT KGP)
• Lec#14-Integrity Constraint by Prof. Partha Pratim Chakrabarti (IIT KGP)
• Lecture - 5 Structured Query Language by Dr.S.Srinath, IIIT Bangalore
• Lecture - 6 Structured Query Language II by Dr.S.Srinath, IIIT Bangalore
• File System 1 by Prof. Partha Pratim Chakrabarti (IIT KGP)
• File System 2 (Indexing) by Prof. Partha Pratim Chakrabarti (IIT KGP)
• File System 3 by Prof. Partha Pratim Chakrabarti (IIT KGP)
• File System 4 by Prof. Partha Pratim Chakrabarti (IIT KGP)
• File System 5 by Prof. Partha Pratim Chakrabarti (IIT KGP)
• Conceptual Modelling( E-R Model-1) by Prof. Partha Pratim Chakrabarti (IIT KGP)

Related Videos (US Styles)

• Introduction to DBMS by Prof. Jennifer Widom at Stanford University
• The Relational Model by Dr. Daniel Soper
• Relational Model by Prof. Jennifer Widom at Stanford University
• Referential Integrity by Prof. Jennifer Widom at Stanford University
• Querying Relational Databases by Prof. Jennifer Widom at Stanford University
• SQL Tutorial for beginners 1/4; SQL Basic Introduction lesson for Software QA Testers @ Portnov
• Indexing Part 1 by Prof. Jennifer Widom at Stanford University
• Indexing Part 2 by Prof. Jennifer Widom at Stanford University
• Database Transactions, part 1: Introduction by Barry Brown
• Database Transactions, part 2: Examples by Barry Brown
• Database Transactions, part 3: ACID and Isolation by Barry Brown
• Database Transactions, part 4: Autocommit Mode by Barry Brown
• Database Transactions, part 5: Scripting by Barry Brown
• ER Model to Relational Mapping by Dr.S.Srinath, IIIT Bangalore
• Data models - ER model by Bart Baesens

Object Relational Database (ORDB) can be considered as portals of relational database to other special databases. Why? The basic properties and functionalities of ORDB will be discussed in this session.

Activities

• Reading: The Beckman Database Research Self-Assessment Report, 2013
• Reading: The The Claremont Database Research Self-Assessment Report, 2008
• Reading: The Lowell Database Research Self-Assessment Report,
• Reading: Michael Stonebraker. "Object-Relational DBMS-The Next Wave." Informix white paper

Related Videos

• Object Relational Database by IIMTS FZE
• Object Relational Database - Unstructured Objects, OIDs, Encapsulation, Inheritance by StudyYaar.com

Spatial Databases is a database optimized for storing and query objects defined in a geometric space. Most spatial databases handle more complex data structures and hence require additional functionality to process spatial data types efficiently. In this session, the basic concepts of spatial databases and designs of spatial indexes will be covered.

Activities

• Reading: Ralf Hartmut Guting. "An Introduction to Spatial Database Systems." VLDB Journal 3(4): 357-399, 1994
• Reading: Antomn Guttman. "R-Trees: A Dynamic Index Structure for Spatial Searching." Proceedings of ACM SIGMOD, pp.47-57, 1984
• Reading: H. Samet, "Spatial data structures." Modern Database Systems: The Object Model, Interoperability, and Beyond, W. Kim, Ed., Addison-Wesley/ACM Press, 1995, 361-385
• Reading: Timos Sellis, Nick Roussopoulos and Chrishtos Faloutsos. "The R+-Tree: A Dynamic Index For Multi-Dimensional Objects." Proceedings of the 13th VLDB Conference, Brighton 1987
• Reading: Christian S. Jensen. "Introduction to Temporal Database Research." Temporal Database Management, 2000

Related Videos

• Database Concept and Spatial Data Models provided by IIRS ISRO Digital Content
• Spatial Queries

To store and access the data via websites requires special designed protocols. In this session, several approaches will be introduced, including HTML, XML, XML schema, JSON.

Activities

• Reading: XML 1.0 (http://www.w3.org/TR/2005/REC-xml-20050204/)
• Reading: Sudarshan S. Chawathe: Describing and Manipulating XML Data. IEEE Data Eng. Bull. 22(3): 3-9(1999)
• Reading: W3.Org, XML Schema (http://www.w3.org/XML/Schema)
• Reading: W3.Org, XML Query (http://www.w3.org/XML/Query)
• Reading: W3.Org, The Extensible Stylesheet Language Family (XSL) (http://www.w3.org/Style/XSL/)

Related Videos

• XML Introductionby Prof. Jennifer Widom at Stanford University
• XML DTD Prof. Jennifer Widom at Stanford University
• XML Schema Prof. Jennifer Widom at Stanford University
• JSON Introduction Part 1 by Prof. Jennifer Widom at Stanford University
• JSON Introduction Part 2 by Prof. Jennifer Widom at Stanford University
• 13.6: XML and JSON - Processing Tutorial by Daniel Shiffman
• 13.7: Manual Parsing - Processing Tutorial by Daniel Shiffman

This is the lab for Elasticsearch, an open source search engine on top of Apache Lucene.

Activities

• Attend the class with your personal laptop
• Assignment One should be submitted before Nov 6

Can the DBMS support the needs of searching data in multiple perspectives? How can we still ensure the efficiency? Multidimensional databases and multimedia databases are the answers. In this session, several techniques for these databases will be introduced.

Activities

• Reading: Torben Bach Pedersen, Christian S. Jensen. "Multidimensional Database Technology", IEEE Computer Dec. 2001
• Reading: S. Geffner D. Agrawal A. El Abbadi "The Dynamic Data Cube" . EDBT'2000
• Reading: Surajit Chaudhuri, Umeshwar Dayal, Venkatesh Ganti. "Database Technology for Decision Support Systems", IEEE Computer Dec. 2001
• Reading: Ching-Tien Ho, Rakesh Agrawal, Nimrod Megiddo, Ramakrishnan Srikant, "Range Queries in OLAP Data Cubes", ACM SIGMOD Record, Volume 26 , Issue 2, Pages: 73 - 88, 1997
• Reading: J. S. Vitter, M. Wang, and B. Iyer. "Data Cube Approximation and Histograms via Wavelets", CIKM'1999
• Reading: C.-T. Ho, R. Agrawal, N. Megiddo, and R. Srikant. Range queries in OLAP data cubes. In Proceedings of the 1997 ACM SIGMOD International Conference on Management of Data, Tucson, AZ, May 1997
• Reading: William I. Grosky, "Managing multimedia information in database systems." Communications of the ACM, Volume 40 , Issue 12 (December 1997), Pages: 72 - 80
• Reading: Ronald Fagin, Combining fuzzy information from multiple systems. J. Computer and System Sciences 58, 1999, pp. 83-99 (Special issue for selected papers from the 1996 ACM Symposium on Principles of Database Systems).
• Reading: Michael S. Lew, Nicu Sebe, Chabane Djeraba, Ramesh Jain, "Content-based multimedia information retrieval: State of the art and challenges",ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), Volume 2 Issue 1 , February 2006
• Reading: Xiaolei Li , Jiawei Han , Hector Gonzalez, High-Dimensional OLAP: A Minimal Cubing Approach, Proceedings of 2004 International Conference on Very Large Data Bases, VLDB2004

Related Videos

• OLAP Introduction Part 1 by Prof. Jennifer Widom at Stanford University
• OLAP Introduction Part 2 by Prof. Jennifer Widom at Stanford University
• Comparing Relational Databases to Multidimensional Databases by Scott Whigham

When the sizes of data set grow rapidly, the ACID properties of traditional DBMS might need to be reconsidered. In this session, we will introduce and discuss the techniques addressing these Big Data challenges. How and Why?

Activities

• Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of OSDI'04: Sixth Symposium on Operating System Design and Implementation, San Francisco, CA, December, 2004.
• Ian Robinson, Jim Webber and Emil Eifrem, Graph Databases,O'Reilly Media, 2015

Related Videos

• NoSQL Introduction by Prof. Jennifer Widom at Stanford University
• Introduction to NoSQL by Martin Fowler
• Modeling Data for NoSQL Document Databases by Ryan CrawCour and David Makogon
• Graph Databases 101 by Jon Haddad

When the sizes of data set grow rapidly, the ACID properties of traditional DBMS might need to be reconsidered. In this session, we will introduce and discuss the techniques addressing these Big Data challenges. How and Why?

Activities

• Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of OSDI'04: Sixth Symposium on Operating System Design and Implementation, San Francisco, CA, December, 2004.
• Ian Robinson, Jim Webber and Emil Eifrem, Graph Databases,O'Reilly Media, 2015

Related Videos

• NoSQL Introduction by Prof. Jennifer Widom at Stanford University
• Introduction to NoSQL by Martin Fowler
• Modeling Data for NoSQL Document Databases by Ryan CrawCour and David Makogon
• Graph Databases 101 by Jon Haddad

Time to evaluate. Different from other examination in our life, we do not want to assess how much we remember. It is more important to know how much we understand. Hence, each student can bring one A4-page paper with all kinds of notes into the classroom. Enjoy.

Notes

• Students can take one A4 page with them

This is the lab for Spark, an engine for big data processing, with built-in modules for streaming, SQL, and graph processing.

Activities

• Attend the class with your personal laptop
• Assignment One should be submitted before Dec 4.

Time for student presentation and discussion based on specified papers

Activities

• Team up with classmates.
• Each group prepare slides no more than 3+1 slides.
• Each group also prepare a good quiz question for your classmates

Realizing by learning, thinking, and doing. This is the final realizing step, to develop a fine application with advanced DBMS skills, for this course. Through this practice, we not only polish our database skills but also experience team works. With teammates, we dare to dream.

Requirements

• Students should work with several people for their project.
• Final Project Requirement Description