Appendix b
Four Level Analysis Methodology
One way of gathering data and then exploring it is to ‘see’ and examine it on four different layers, or levels. A framework for data gathering data and analysis was needed; and this method was used to filter data from the field and ensure that we went beyond the level of straight description to the ordering of data so that valid conclusions could be drawn.
Description: this is the first level of data collection and analysis. In any research a necessary first, and ongoing step, is to keep an open mind and to accurately describe situations and interview responses. Through key informants we were able to ‘get inside’ a number of farm families, look, listen, learn, ask questions, and take rides over the farm on four wheel bikes or jeeps. Much of Parts 5 and 6 is description of what we found.
Cognition: the second layer is called cognition. Translated this means what people understood about what was happening. We encouraged people to tell their stories, share what they considered was important, what they thought had happened, is happening in their families, in farming, and in the community. The cognition level is also a component of Parts 5 and 6. The interesting and new contribution made through the use of this tool is found in the third and fourth layers of analysis. The third is about exploring the norms in a society, the fourth about explanation.
Norms: these are the underlying values of a society - beliefs about what is right, wrong and appropriate behaviour that are held by the group studied. They are ‘the shoulds, should nots’ of society. Norms are central to culture. Those with power in society have influence over norms at any given period. For example: Federated Farmers used to have more power to influence what was done on farms than people suggest it currently has. Sometimes change in values, in norms, is subtle. This is apparent in terms of succession, or off farm employment. Marked changes have occurred in what is now considered ‘normal’ or acceptable in both these areas. Change ‘accumulates’ over time in such situations, until there is a ‘push’ from what is considered to be ‘ab-normal’ to ‘normal’, ‘deviant’ to ‘normal’.
Anomie is a disaffected state that arises when the norms of a society are seriously disturbed, and people suffer from a sense of aimlessness or confusion. The term has relevance for what is happening in the mid-Rangitikei; and it was important to explore what is changing in regard to the norms in this area.
Explanation: this fourth level of analysis is the most risky because it involves interpretation of data by the researcher. Any gathering of data involves selection and interpretation. It is not possible in this kind of research to ‘capture the whole picture’ or layers of meanings, or draw rigid parameters around what one will explore, what one will omit. This fourth layer of analysis means, therefore, that the researcher must make some critical assessment of the data, interpret, order it, and try and make sense of it.
The best way to ensure integrity of the data is to move continuously backwards and forwards through the other layers - descriptive, cognitive and normative - and then to check back with respondents to ensure the picture fits. Constant checking through the first three layers, and checking back with people involved in the research, mitigates against bias and preconceived conclusions in the fourth layer.
Contact for Enquiries
Rural Affairs Coordinator
Sector Performance Policy
MAF Policy
Ministry of Agriculture and Forestry
PO Box 2526
Wellington
NEW ZEALAND
Phone: +64 4 894 0675
Fax: +64 4 4 894 0745
Contact this person
