How was daily life in the colonies for the minority groups?

I assume by "colony" you are referring to the English colonies of North America. The answer is that it depended on how you define "minority" and what time period you are talking about. 
Jamestown (1607) was the first permanent English colony in North America and it was colonized with English men and boys; only two women arrived a year later. If we consider women as a minority in terms of the rights they had, then the women of the early colonies had roughly the same rights they enjoyed back in England--basically none. They could not vote nor hold public office; however, they did serve a pivotal role in providing stability, without which the colony and later colonies would not have survived.
But by "minorities" you probably mean non-Europeans, which in a colonial context meant Africans (I will not address American Indians here). The first 20 Africans to arrive in North America arrived in Jamestown as indentured servants after being captured from a Portuguese slave ship. Most gained their freedom after several years. However, indentured servitude--even slavery--occurred among Europeans as well, and there were even cases of blacks and American Indians owning indentured whites. The first person to be enslaved for life did not occur until 1640 and it was another 20 years before slavery laws were introduced.
Through most of the mid to late 1600s, blacks and whites enjoyed many of the same freedoms. Free blacks owned land, businesses, and some also owned slaves. But as slavery became more the norm, restrictions on blacks--free and slave--became codified to a greater degree. Firearm prohibitions, prohibitions against congregating in large numbers, as well as restrictions on property were introduced. Laws against intermarriage were also passed by the 1690s. Intermarriage between Europeans and Africans did occur, which also precipitated laws regarding the status of children from such unions. Free black men marrying white women also ran the risk of being sold into slavery beginning in the first quarter of the 1700s.
Over the decades leading up to the American Revolutionary War, the lives of blacks both free and slave became increasingly bifurcated between the southern and northern colonies, particularly as anti-slavery laws were passed in the north. This bifurcation was an immense hurdle in the creation of the US and would ultimately result in the American Civil War. So we can conclude that the rights of blacks went from something similar to whites early on in the colonies, only to become heavily restricted as colonies grew and slavery became more entrenched.
http://www.historyrocket.com/American-History/colonial-america/Women-Rights-During-Colonial-America.html

https://www.nps.gov/jame/learn/historyculture/african-americans-at-jamestown.htm

https://www.nps.gov/jame/learn/historyculture/the-indispensible-role-of-women-at-jamestown.htm