There may be complex and unknown relationships between the variables in your dataset.
It is important to discover and express the degree to which variables in your dataset are dependent upon each other. This knowledge can help you better prepare your data to meet the expectations of machine learning algorithms, such as linear regression, whose performance will degrade with the presence of these inter-dependencies.
In this tutorial, you will discover that correlation is the statistical summary of the relationship between variables and how to calculate it for different types variables and relationships.
Today i will give a brief introduction over Hypothesis testing. I put all those concept together and examples using python.
Lets answer some questions first.
What is hypothesis testing ? why do we use it ? what are basic of hypothesis ? which are important parameter of hypothesis testing ?
1. What is hypothesis testing ?
Hypothesis testing is a statistical method that is used in making statistical decisions using experimental data. Hypothesis Testing is basically an assumption that we make about the population parameter.
(1) you say avg student in class is 40
(2) a boy is taller than girls. …
We see these news coming out . Here I am trying to give you datasets that are available now for the public. But the contents in those websites may subject to change according to different situations. So lets begin
OPEN data sets have only now started becoming available for researchers, analysts, professionals and students to carry out various projects and research. In new tech fields like analytics, machine learning and artificial intelligence, there is a constant need for datasets to perform tasks like planning projects, building models or using it for education.
While there are several readily-available datasets provided by companies, communities, government bodies, government institutions and others, there is often a need to clean these data before it is usable. These datasets can be accessed either freely (which most government websites are) or by paying nominal charges. I am listing here such India-based datasets from the public domain and government bodies which can come in handy for your projects. …
What are List Comprehensions ?
List comprehension is an simple way to define and create list in python. We can create lists just like mathematical statements and in one line only. The syntax of list comprehension is easier to grasp.
List comprehensions provide us with a simple way to create a list based on some iterable. An iterable is something you can loop over.
A list comprehension generally consist of these parts :
1. Output expression(optional)
3. Iterator variable
Now see the syntax ., first see how it looks in for loop then in List Comprehension
# In a for loop
for item in list: