1. Research Methods for Computer Science/Software engineering (CS601)
School of Computer Science and Technology (HILCoE) By
Dr. Temtim Assefa
Revised September, 2016

2. Learning Objectives Explain the purpose of research
Understand basic concepts in research (constructs, relationship, indicators, research model, theory, etc)
Understand research as a scientific method to acquire knowledge
Acquire skill to formulate researchable research problems
Identify major research problems in computer and software engineering
Explain the different research approaches and methods (Quantitative, qualitative and design science)

3. Objective …
Justify the rational for selecting a particular research method to solve your research problems
Able to design research projects or research proposal
Able to develop instruments and collect data relevant to the research problem
Undertake validity and reliability tests of research instruments

4. Objective … Able to interpret data into meaningful information
Acquire skill to plan, execute, and implement research projects in computer science and software engineering
Able to review published research articles
Able to produce publishable research articles (conference or journal articles)
Contribute new knowledge to your discipline

5. Meaning, objective and Overview of research

6. What Research Is Not
Gathering information from resources such as books or magazines isn’t a research.
Merely transporting facts from one resource to another doesn’t constitute research.
Has no contribution to new knowledge, although this might make existing knowledge more accessible.

7. Research is not
Research is not simply learning about something
Gathering information to know more about a certain area is different from looking at a body of data and deciding how it contributes to the solution of a problem
Research problems do not simply result in a “yes” or a “no” answer
Should able to explain why something is happened - e.g computer increases organizational efficiency but add how it contributes?

8. Research: A Definition
“…the systematic process of collecting and analyzing ata) in order to increase our understanding of the phenomenon about which we are concerned or interested.”
an activity that contributes to the understanding of a phenomenon [Kuhn, 1962; Lakatos, 1978]

9. Research ... Main elements in research domain knowledge:
phenomenon: a set of behaviors of some entity(ies) that is found interesting by a research community
How employees acquire software development skills
understanding: knowledge that allows prediction of the behavior of some aspect of the phenomenon
knowledge on learning skills makes other programmers‘ life easier

10. Mian components..
activities considered appropriate to the production of understanding (knowledge) are the research methods and techniques of a research community

11. Research Characteristics
Originates with a question or problem.
Requires clear articulation of a goal or objective.
Follows a specific plan or procedure.
Often divides main problem into sub-problems.
Guided by specific problem, question, proposition or hypothesis.
Accepts certain critical assumptions.
Requires collection and interpretation of data.
Cyclical (helical) in nature.

12. Types of Research
Basic Research
its main purpose is the disclosure of fundamental truths or principles
Focuses the testing and development of theory
To extend existing human understanding
Has no immediate application to real world problems
Example -
Physists are interested in understanding basic elements that make up matter
Computer scientist are interested to create an efficient algorithm to process data, retrieve information, etc

13. To solve existing societal problems Example - software automation like
Cont’d
Applied research
To solve existing societal problems
Example - software automation like
Developing a SW that convert word files into database format
Doing payroll processing by a computer
Developing a program that copys files from a computer to a mobile phone

14. Basic Concepts in Research

15. Epistemology of Knowledge
is the branch of philosophy concerned with the nature and scope (limitations) of knowledge
It answers the following questions
What is knowledge?
How is knowledge acquired?
To what extent is it possible for a given subject or entity to be known?

16. There are two views of knoweldge Knowledge as objective Truth
Continued …
There are two views of knoweldge
Knowledge as objective Truth
Knowledge as subjective truth

17. Objective Truth
Plutonian Epistemology or Plutonian view of knowledge states that knowledge is merely an awareness of absolute, universal Ideas or Forms, existing independently of any subject trying to apprehend to them
Knowledge can be measured by measuring instruments
Observed independent of the researcher
Can be quantified using different statistical methods
It is constructed by deductive methods

18. Subjective truth
Aristotelian Epistemology view puts more emphasis on logical and empirical methods for gathering knowledge, yet he still accepts the view that such knowledge is an apprehension of necessary and universal principles
Knowledge is constructed mainly through observation and experience.
People are born with blank sheet of mind which of course filled through experience

19. Subjective truth Knowledge is a human construct
People born with some thought constructs that are used to interpret and give meaning what we experience
It is the human that gives meaning to real world objects
It is a social construct and exits in the language talked by people
“language is the mirror of the mind”

20. Cont’d
Knowledge is constructed by reflection, interpretation what respondent says
The researcher is part of the knowledge construction process
It is constructed by inductive method
From observations, general truths are drawn
There are as many truth as the there are many number of people

21. Theory
An abstraction of realities that serve as a guide for future practice
You may think theory as an absolute truth, such as the theory of gravity or the theory of relativity
Actually a changing phenomenon, especially in the soft or social sciences. 
Theories are developed based on what is observed or experienced, often times in the real world. 
Changed as we gather new facts and observe new relationship

22. Theory -- Cont’d
Dubin (1978) notes theory contains three main elements:
A set of well-defined concepts (or units);
Laws of interaction (or interrelationships between the units);
A boundary within which the theory holds.
Example
Theory of planned behavior
Design theory
Communication theory
Human Computer Interaction theory (HCI), etc

23. Theory of Planned Behavior
Attitude
Intention
Behavior
Subjective Norms
Controlling Variables
Source – Ajzen, 1991

24. Constructs and Variables
Constructs are abstract concepts which cannot be measurable
It is similar to classes in object oriented programming
Examples: motivation, SW quality, security, person
Variables are things which we can observe and measure it.
Example for person construct, variables are height, age, color
Sometime these words may have interchable role depending the research scope

25. Conceptual Framework
It is the researchers understanding of the Research Problem
Conceptual framework = Mental models
Jay Wright Forrester defined general mental models as:
"The image of the world around us, which we carry in our head, is just a model. Nobody in his head imagines all the world, government or country. He has only selected concepts, and relationships between them, and uses those to represent the real system."

26. Conceptual …
It contains variables and their relationship to be investigated in the research
It serve as a guide for the research process
It is build from existing theory or prior experience of the researcher
It is accepted or modified after the collected empirical data is analyzed and interpreted
simplify reality by selecting certain phenomena/variables and suggesting certain relationships between them;
are judged in terms of its utility, not correctness.

27. Types of Conceptual Framework
Cause and Effect
Such framework represents the effect of one variable over the other.
These variables are referred to as Independent (cause) and dependent variable (effect).
Example Technology Acceptance model predicts what factors contribute for acceptance of a new technology
This model derived from Diffusion of Innovation theory

28. Cause and Effect – explanation …
Perceived usefulness
Intention to use
Software acceptance
Perceived ease of use

29. Type of CF … Stages in a Process
the concepts are related because they are stages in a process.
Example Project Management Problem
It starts with planning and
then proceeds through the stages of doing,
monitoring and
Revising the plan.
Here the theory is represented as a circle that flows in a cycle.
What about software development theory?

30. Type of CF … Hierarchical relationships
In many conceptual frameworks, concepts are related because they occupy higher or lower positions on a scale or in a hierarchy.
Example Maslow’s (1954) Need Hierarchy
physiological needs
safety needs
belongingness needs
esteem needs
self-actualisation.

31. Type of CF … Map and coordinates
You can define the relationships between concepts by plotting
them against a series of coordinates.
High
Internal knowledge
Defensive organization
Innovator organization
External knowledge
Low High

32. Theory visa-vis Conceptual Framework
Conceptual frameworks provide generalisations about processes, about the interaction of the concepts,
whereas theories provide hypotheses about the outcomes of these processes.
A conceptual framework might perceived usefulness, easy of use and self efficacy etc linked with software success. Shows interaction of variables
Theory would show the outcome of these factors. Concerned with prediction.

33. Proposition
Predictions about the world are made using propositions, that is, conclusions that may be deduced logically from the theory.
It is a relationship between two or more constructs
It guides the research process in data collection and data analysis
Used in qualitative research methods especially in case study research

34. Proposition … Example
Proposition #1 --- ERP implementation can be successful only if there is a strong and committed leadership guiding the initiative” (Sarker and Lee 2000, p416)
“Proposition #2 ----ERP implementation can be successful only if there is open and honest communication among the stakeholders” (Sarker and Lee 2000, p416)
“Proposition #3 --- ERP implementation can be successful only if the implementation team is empowered and balanced” (Sarker and Lee 2000

35. Hypothesis
A hypothesis is an empirically testable statement that is generated from a proposition
Hypothesis is a tentative solution forwarded by the researcher based on previous theory or experience
It is expressed in terms that support collection and analysis of empirical data
Terms used in the hypothesis are “things observable” (Dubin 1978)
One proposition may generate many hypotheses

36. Hypothesis …
Example
Graphical software interface increases SW learnability.
Cloud service reduces IT operation costs
Component based SW development increases SW project success
The deductive testing of hypotheses involves looking for disconfirming evidence to falsify hypotheses (Lee 1989).
Falsified hypotheses are then refined based on the reasons for falsification and subjected to further empirical testing.

37. Methodology
A methodology is “a system of principles, practices, and procedures applied to a specific branch of knowledge
A methodology might help researchers to produce and present high quality research results that is accepted as valuable, rigorous, and publishable in Computer Science research outlets.
Method is one component in the Methodology
Data collection method like interview
Data analysis method like open coding, correlation, regression, etc
Method of prototype system evaluation – how do you evaluate it

38. Definitions of Terms
Define each technical term as it is used in relation to your research project.
Resource – how is defined in the context of library and computer system
This helps remove significant ambiguity from the research itself by ensuring that reviewers, while they may not agree with your definitions, at least know what you’re talking about. .

39. Metrics in Research
Metrics are measures used to represent the variable
For example:
a sex variable is measured by Male or Female
Attitude is measured by likearte scale (Very strongly disagree <->Strongly Agree)
How do you measure CPU performance?
Clearly state how you measure your research variable

40. Scales of variable measurement
There are four measurement scales
Nominal – which does not show magnitude like male or famale
Ordinal – which measure magnitude but cannot quantify difference e.g poor and rich
Interval - measures magnitude and the difference between the two values
e.g age years and 20 years
Scale – measures which has vales below zero e.g temperature

41. Know your Research Contributions
In what way(s) does your study add significant contribution(s) to:
Extant Theory?
Relevant Practice?

42. Free Access Journals