Q1. Select the suitable answer for the following Multiple-choice questions.
i. __ is a structured or processed collection of data usually associated with a unique body of work.
Answer: a) Database
Explanation: A database is an organized collection of structured data stored electronically in a computer system, typically controlled by a database management system (DBMS).
ii. __ refers to the process of carefully examining and studying data to identify patterns, draw conclusions, or make the data meaningful.
Answer: a) Data analytics
Explanation: Data analytics is the systematic process of inspecting, cleansing, transforming, and modeling data to discover useful information, draw conclusions, and support decision-making.
iii. __ is the graphical representation of data through use of common charts, plots, infographics, and animations.
Answer: c) Data visualization
Explanation: Data visualization is the graphical representation of information and data using visual elements like charts, graphs, and maps to make complex data more accessible and understandable.
iv. __ is subset of Machine learning, with emphasis on the simulation or imitation of human brain's behavior by using artificial neural networks.
Answer: c) Deep learning
Explanation: Deep learning is a subset of machine learning that uses artificial neural networks with many layers (deep networks) to simulate human brain behavior for tasks like image and speech recognition.
v. __ is the use of data to predict future trends and events based on historical data.
Answer: b) Predictive analysis
Explanation: Predictive analytics uses historical data, statistical algorithms, and machine learning techniques to identify the likelihood of future outcomes.
vi. __ is the fast rate at which data is received and acted on.
Answer: b) Velocity
Explanation: Velocity refers to the speed at which data is generated, collected, and processed. It is one of the "3 Vs" of Big Data (Volume, Velocity, Variety).
vii. __ includes the data which can only take certain values and cannot be further subdivided into smaller units.
Answer: a) Discrete data
Explanation: Discrete data consists of distinct, separate values that cannot be subdivided. Examples include the number of students in a class (you can't have 2.5 students).
viii. __ is limitation of big data.
Answer: b) Unlimited growth of data
Explanation: The rapid and unlimited growth of data can be a challenge, requiring scalable storage and processing infrastructure. Other limitations include data quality, privacy concerns, and cost.
ix. Customer satisfaction level such as satisfied, dissatisfied, and neutral are examples of __ data type.
Answer: a) Ordinal data
Explanation: Ordinal data represents categories with a meaningful order or ranking (e.g., satisfied > neutral > dissatisfied), but the intervals between them are not equal.
x. __ is a method of collecting information from individuals.
Answer: a) Survey
Explanation: A survey is a data collection method that involves asking people questions to gather information about their opinions, behaviors, or characteristics.
1) Define data analytics and data science. Are they similar or different? Give reason.
Answer:
Data Analytics: The process of examining datasets to draw conclusions about the information they contain, often using specialized tools and techniques. Data Science: A broader, interdisciplinary field that uses scientific methods, algorithms, and systems to extract knowledge and insights from structured and unstructured data. Similarity/Difference: They are related but different. Data science is a broader field that includes data analytics as a subset. Data science involves more programming, machine learning, and building predictive models, while data analytics focuses more on analyzing existing data to answer specific questions.
2) Can you relate how data science is helpful in solving business problems?
Answer: Data science helps solve business problems by:
Customer Insights: Analyzing customer behavior to personalize marketing and improve products. Operational Efficiency: Optimizing supply chains and reducing costs. Risk Management: Predicting financial risks and detecting fraud. Decision Making: Providing data-driven insights for strategic planning. Competitive Advantage: Identifying market trends and opportunities before competitors.
3) Database is useful in the field of data science. Defend this statement.
Answer: Databases are essential for data science because they provide a structured and organized way to store, manage, and retrieve large volumes of data. Data scientists rely on databases (SQL and NoSQL) to access clean, consistent data for analysis. Databases ensure data integrity, security, and efficient querying, which are crucial for building accurate models and deriving meaningful insights. Without databases, managing and analyzing big data would be impractical.
4) Compare machine learning and deep learning, in the context of formal & informal education.
Answer:
| Feature | Machine Learning | Deep Learning |
| Definition | Subset of AI that learns from data. | Subset of ML using deep neural networks. |
| Data Needs | Works with smaller datasets. | Requires large datasets. |
| Feature Extraction | Manual feature engineering. | Automatic feature learning. |
| Formal Education | Used to predict student performance. | Used for personalized learning paths. |
| Informal Education | Recommender systems for courses. | Advanced AI tutors and chatbots. |
5) What is meant by sources of data? Give three sources of data excluding those mentioned in the book.
Answer: Sources of data refer to the origins from which data is collected. Three sources excluding those mentioned in the book:
1. Social Media Platforms: User posts, likes, shares, and comments (e.g., Twitter, Facebook).
2. IoT Devices: Sensors in smart homes, wearables, and industrial equipment.
3. Public Records: Government databases, census data, and open data portals.
6) Differentiate between database and dataset.
Answer:
| Feature | Database | Dataset |
| Definition | An organized collection of structured data. | A collection of related data points. |
| Scope | Can contain multiple datasets. | A single collection of data. |
| Management | Managed by a DBMS. | Can be a file (CSV, Excel). |
| Structure | Highly structured (tables, relationships). | May be structured or unstructured. |
| Example | MySQL, Oracle, SQL Server. | A CSV file of customer data. |
7) Argue about the trends, outliers, and distribution of values in a data set?
Answer:
Trends: Trends show the general direction in which something is developing or changing over time. Identifying trends helps in forecasting and decision-making. Outliers: Outliers are data points that differ significantly from other observations. They can indicate errors or unusual events, and must be handled carefully as they can skew results. Distribution of Values: This describes how data points are spread across the range of possible values. Understanding distribution (e.g., normal, skewed) is crucial for choosing appropriate statistical tests and interpreting data correctly.
8) What are summary statistics needed?
Answer: Summary statistics are needed to:
Describe Data: Provide a concise overview of the data's central tendency (mean, median, mode) and dispersion (range, variance, standard deviation). Identify Patterns: Help in understanding the shape of the data distribution. Compare Groups: Allow comparison between different datasets. Detect Outliers: Highlight unusual values. Support Decision Making: Provide a basis for informed decisions.
9) Express big data in your own words. Explain three V's of big data with reference to email data. (Hint: An email box that contains hundreds of emails)
Answer: Big data refers to extremely large and complex datasets that traditional data processing software cannot manage. The three V's are:
Volume: The sheer amount of data. Example: An email inbox with thousands of emails, each with attachments. Velocity: The speed at which data is generated and processed. Example: Hundreds of new emails arriving every hour. Variety: The different types of data. Example: Emails contain text, images, attachments (PDFs, Word docs), and metadata (sender, time).
10) Illustrate the purpose of data storage?
Answer: The purpose of data storage is to:
Preserve Data: Keep data safe and available for future use. Enable Access: Allow quick and efficient retrieval of data when needed. Support Analysis: Provide a repository for data analysis and reporting. Ensure Security: Protect data from unauthorized access and loss. Facilitate Backup: Enable data recovery in case of system failure.
1) Sketch the key concepts of data science in your own words.
Answer: Data science is an interdisciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge and insights from structured and unstructured data. Its key concepts include:
1. Data Collection:
Gathering raw data from various sources like databases, APIs, web scraping, and sensors. Data can be structured
(tables), semi-structured (JSON), or unstructured (text, images).
2. Data Cleaning and Preprocessing:
Raw data is often noisy, incomplete, or inconsistent. Cleaning involves handling missing values, removing duplicates, and correcting errors. Preprocessing includes normalization, scaling, and encoding categorical variables.
3. Exploratory Data Analysis (EDA):
Using statistical and visualization techniques to understand the data's structure, patterns, and relationships. Techniques include histograms, scatter plots, and correlation matrices.
4. Feature Engineering:
Creating new features or transforming existing ones to improve model performance. This requires domain knowledge and creativity.
5. Machine Learning:
Building predictive models using algorithms like linear regression, decision trees, and neural networks. Models are trained on historical data and evaluated on test data.
6. Model Evaluation and Deployment:
Assessing model performance using metrics like accuracy, precision, recall, and F1-score. Deploying the model into production for real-world use.
7. Communication and Visualization:
Presenting findings to stakeholders using clear visualizations and reports. Storytelling with data is crucial for driving action.
In summary, data science is a comprehensive process that transforms raw data into actionable insights.
2) Develop your own thinking on the various data types used in data science.
Answer: In data science, data types are broadly categorized into structured, semi-structured, and unstructured data.
1. Structured Data:
Highly organized and formatted data, typically stored in relational databases. It is easy to search and analyze. Examples: Names, dates, credit card numbers, product prices. Data Types: Numeric (integer, float), Text (string), Date/Time, Boolean.
2. Semi-Structured Data:
Data that does not conform to a rigid structure but has some organizational properties like tags or markers. Examples: JSON, XML, HTML. Use: Common in web data and APIs.
3. Unstructured Data:
Data that lacks a predefined format or organization. It is difficult to analyze directly. Examples: Text documents, images, audio, video, social media posts. Use: Requires advanced techniques like Natural Language Processing (NLP) and Computer Vision.
4. Quantitative vs. Qualitative Data:
Quantitative: Numerical data that can be measured (e.g., height, weight, temperature). Qualitative: Descriptive data that can be observed but not measured (e.g., colors, textures, opinions).
5. Discrete vs. Continuous Data:
Discrete: Countable values (e.g., number of children). Continuous: Measurable values that can take any value within a range (e.g., height, time).
Understanding these data types is crucial for selecting appropriate analysis techniques and tools.
3) Compare how big data is applicable to various fields of life. Illustrate your answer with suitable examples.
Answer: Big data is applicable across numerous fields, transforming how decisions are made.
1. Healthcare:
Application: Analyzing patient records, genomic data, and wearable device data to predict disease outbreaks and personalize treatments. Example: Google Flu Trends predicted flu outbreaks by analyzing search queries.
2. Business and Retail:
Application: Analyzing customer purchase history and browsing behavior to optimize inventory and personalize marketing. Example: Amazon recommends products based on past purchases and views.
3. Finance:
Application: Detecting fraudulent transactions in real-time and assessing credit risk. Example: Credit card companies use big data to flag suspicious transactions.
4. Education:
Application: Analyzing student performance data to personalize learning and identify at-risk students. Example: Adaptive learning platforms adjust difficulty based on student responses.
5. Transportation:
Application: Optimizing traffic flow and route planning using GPS data. Example: Google Maps uses real-time traffic data to suggest faster routes.
In summary, big data is revolutionizing decision-making across all sectors by providing actionable insights from massive datasets.
4) Relate the advantages and challenges of big data?
Answer: Advantages of Big Data:
Informed Decision Making: Provides insights for better strategic decisions. Personalization: Enables tailored products and services. Efficiency: Optimizes operations and reduces costs. Innovation: Drives new products and business models. Predictive Capabilities: Forecasts trends and prevents problems.
Challenges of Big Data:
Data Volume: Storing and processing massive datasets is costly. Data Velocity: Real-time processing requires powerful infrastructure. Data Variety: Integrating different data types is complex. Data Quality: Ensuring accuracy and consistency is difficult. Privacy and Security: Protecting sensitive data from breaches. Cost: Investment in technology and skilled personnel. Skill Gap: Shortage of professionals with big data expertise.
In summary, while big data offers immense potential, it also presents significant challenges that must be managed.
5) Design a case study about how data science and big data has revolutionized the field of healthcare.
Answer: Case Study: Big Data in Healthcare - Predicting Disease Outbreaks
Background: Healthcare generates vast amounts of data daily, from electronic health records (EHRs) to genomic sequences and wearable device data. Big data analytics is transforming healthcare by enabling early disease detection, personalized medicine, and efficient resource allocation.
Problem: Traditional disease surveillance methods are slow and often reactive. By the time an outbreak is detected, it has already spread.
Solution: Using big data analytics, health organizations can analyze real-time data from multiple sources:
Social Media: Tracking keywords related to symptoms. Search Engines: Analyzing search queries for health-related terms. Wearable Devices: Monitoring heart rate and temperature data. EHRs: Analyzing patient diagnoses and prescriptions.
Implementation: Machine learning models process this data to identify patterns indicating an outbreak. For example, a sudden increase in flu-like symptoms in a specific region can trigger an alert.
Outcome: Early detection allows for rapid response, such as deploying vaccines and medical supplies, and implementing public health campaigns.
Conclusion: Big data and data science have revolutionized healthcare by shifting from reactive to proactive approaches, ultimately saving lives and reducing costs.
Conduct a survey: Objective: To help students understand the process of data collection through survey and questionnaires. Instructions:
i. Provide the class with a sample questionnaire about the sentiments analysis of small enterprises. Sample questions may include: why did you choose this business/occupation? How do you manage to meet the market competition? What limitations do you feel about your business? What short term and long-term goals/objectives have you set regarding your business?
ii. Ask the students to modify the questionnaire according to their favorite business/occupation. Help the students in modifying the questionnaire.
iii. Arrange a field trip or ask the students to get it filled by asking questions from relevant shopkeepers around them.
iv. Let the students arrange the collected data and organize it for the next activity. Outcome: This activity will help students understand various businesses/occupations around them as well as understand the opportunities and shortcomings regarding various businesses.
Answer: (This is a group activity. The goal is to practice data collection through surveys. Students should create a questionnaire, visit local businesses, collect responses, and organize the data.)
Data Visualization: Objective: To help students understand the process of data visualization.
i. Ask the class to make groups according to the professions about which they conducted survey. Group similar professions according to their nature.
ii. Ask the students to plot the data by using charts and graphs. They can use software tools if available.
iii. Let the students draw conclusions about various professions and what are the limitations of businesses about their businesses.
iv. Ask the students to add modifications to the current businesses model to overcome the existing shortcomings.
Outcome: This activity will help students understand data visualization and how it is helpful for decision making to improve it and make new strategies or modifying the existing one.
Answer: (This is a group activity. The goal is to practice data visualization. Students should create charts and graphs from the collected data, draw conclusions about business limitations, and propose improvements.)
Data collection about various businesses: Objective: To help students understand the importance of data collection to get insight about data.
v. Divide the class into small groups (5 to 6 students) and assign each a business topic, preferably from their own surroundings, so that students have appropriate information about it.
vi. Instruct each group to write a case study, that how that business can be related to big data.
vii. Each group will present their case study and other groups can ask questions about it, try to keep it a supervised interactive session. Outcome: This activity will help students understand the relationship and impact of big data on various businesses.
Answer: (This is a group activity. The goal is to understand the relationship between big data and businesses. Students should research a local business, write a case study on how big data can benefit it, and present their findings.)
