What is the difference between a holistic perspective and a partial point of view?

A holistic perspective considers the whole system or situation, while a partial point of view focuses on a specific aspect or part.

A holistic perspective focuses on specific details, while a partial point of view considers the whole system.

A holistic perspective and a partial point of view cannot be distinguished.

A holistic perspective and a partial point of view are the same thing.

A holistic perspective ignores the big picture, while a partial point of view takes into account every aspect.

The difference between holistic perspective from partial point of view

New Trends in Agriculture Extension approaches Extension has been, and still is, under attack from a wide spectrum of politicians and economists over its cost and financing. As a result, Extension Systems have had to make changes, by restating the system’s mission, developing a new vision for the future, and formulating plans for the necessary transition to achieve the desired change. 1. Privatization of Agricultural Extension Service Privatization: Process of funding and delivering the extension services by private individual or organization is called Private Extension. Concept: Privatization of extension refers to services rendered in rural area & allied aspects of extension personnel working in private agencies or organization for which farmers are expected to pay a fee & it can be viewed as supplementary or alternative to public extension services (Sarvanan & Shivalinge 1980). Privatization approaches ➢ Share cropping system ➢ Village extension contract system ➢ Public extension through private delivery ➢ Service for vouchers Strengths of Private Extension System ➢ More demand - driven rather than supply – driven ➢ High quality of services in terms of satisfying information needs of clientele, trained manpower, sustained finances and resource allocation ➢ Provides for an information mix and choices available to farmers ➢ Enhanced efficiency of staff ➢ Assure continuous supply and quality agricultural products ➢ More effective because farmer can select an adviser who is the best able to help ➢ Healthy competition among service provider will lead to better quality and lower costs for service Weakness of Private Extension System ➢ Concentrate on area having favorable physical environment ➢ More face-to-face contacts (person oriented) ➢ Increased dependence of farmers and hence exploitation ➢ No education role ➢ Deprivation of small farmers ➢ Hamper the free flow of information 2. Cyber Extension or e-extension Concepts Cyber space: it is the imaginary or virtual space of computers connected with each other on Networks, across the Globe. Cyber extension: it means 'using the power of online networks, computer communications and digital interactive multimedia to facilitate dissemination of agriculture technology. Cyber Extension thus can be defined as the extension over cyber space. Important tools of cyber extension E-Mail, Telnet, File Transfer Protocol (FTP), Gopher, Archie and World Wide Web (WWW) Strengths of Cyber Extension ➢ Access to the astounding information and continuously available ➢ Information rich and instantaneously available of information ➢ Interactive communication ➢ The information is available from any point on the globe ➢ Communication is dynamic ➢ Cut steps from traditional process ➢ Save money, time and effort ➢ Multiplicity of purpose Issues and Concerns of Cyber Extension ➢ Lack of Reliable Telecom Infrastructure in Rural Areas ➢ Erratic or no Power Supply ➢ Lack of ICT Trained manpower (willing to serve) in Rural Areas ➢ Lack of content (locally relevant and in local languages) ➢ Lack of Information Services to Rural Clientele ➢ Low Purchasing power of the Rural communities ➢ Lack of Holistic Approaches ➢ Issues of Sustainability Application of cyber extension ➢ Village information shops Dr. M.S. SwaminathanResearch Foundation, Chennai ➢ Information villagers MANAGE in Ranga Reddy District in Andhra pradesh ➢ Gyandoot net initiative of District Dhar, Madhya Pradesh. ➢ Warna wired village of National Informatics Center (NIC) in Kolhapur- Sangli Districts of Maharashtra 3. Market-Led-Extension (MLE) Concepts Market: A congregation of prospective buyers & sellers with a common motive of trading a particular commodity. Extension: It is the spreading/reaching out to the mass Market-led-extension: Agriculture & economics coupled with extension is the perfect blend for reaching at the door steps of common man with the help of technology. Dimensions of market-led extension ➢ Marketing mix: A planned mix of the controllable elements of a product's marketing plan commonly termed as 4Ps: product, price, place, and promotion. These four elements are adjusted until the right combination is found that serves the needs of the product's customers, while generating optimum income. ➢ Marketing plan: A marketing plan is a comprehensive document that outlines a business and marketing efforts for the coming year. It describes business activities involved in accomplishing specific marketing objectives within a set time frame. A marketing plan also includes a description of the current marketing position of a business, a discussion of the target market and a description of the marketing mix that a business will use to achieve their marketing goals. ➢ Market Intelligence: It is the information relevant to a company’s markets, gathered and analyzed specifically for the purpose of accurate and confident decision making. Market intelligence includes the process of gathering data from the company’s external environment, whereas the business intelligence process is primarily based on internal recorded events – such as sales, shipments and purchases. ➢ Market oriented production ➢ Use of Technology Strengths of market-led extension ➢ SWOT analysis of the market ➢ Organization of Farmers’ Interest Groups (FIGs) ➢ Enhancing the interactive and communication skills of the farmers ➢ Establishing marketing and agro-processing linkages ➢ Advice on product planning ➢ Educating the farming community ➢ Direct marketing ➢ Acquiring complete market intelligence ➢ Publication of agricultural market information Production of video films of success stories ➢ Challenges to market-led extension ➢ Gigantic size of extension system ➢ Information technology Diverse conditions ➢ Market intelligence ➢ Reforms in agricultural extension system Government Initiatives ➢ Central warehousing Corporation-1965 ➢ MSP by Commission for Agricultural Cost and Price (CACP) ➢ Food Corporation of India ➢ Then some others as: Cotton Corporation of India (CCI), Jute Corporation of India (JCI), National Dairy Development Board (NDDB), Agriculture and Processed food Export Development Authority (APEDA) etc. 4. Farmer--Led-Extension (FLE) Farmer--led-extension is defined as 'the provision of training by farmers to farmers, often through the creation of a structure of farmer promoters and farmer trainers' (Scarborough et al., 1997). Philosophy and principles ➢ Farmers and local institutions (e.g. producer organizations or village leaders) should play a key role in selecting farmer-trainers and monitoring and evaluating them. This helps make the programmes more accountable to the community or groups that they serve. ➢ Farmer-trainers are ‘of the community’; they communicate in local languages and are more sensitive to local cultures, mannerisms, farming practices, and farmers’ needs. ➢ Farmer-trainers should be selected on the basis of their skills and interest in sharing information, not just on their farming expertise. ➢ Farmer-trainers need strong linkages with and support from development agents (whether government, non-government organization (NGO), or private), the people who train and backstop them. Farmer-trainers generally serve as a complement to existing extension systems, rather than being a substitute for them. ➢ Facilitating organizations and local institutions need to be proactive in ensuring that women as well as men become farmer-trainers. ➢ Simple and appropriate reference materials should be made available to the farmer trainers. Essential Elements of Farmer--led-extension ➢ The group ➢ The Field ➢ The Facilitator ➢ The curriculum ➢ Programme leader ➢ Financing Special features of Farmer--led-extension ➢ All learning is field based & it is primary venue for learning ➢ FLE group learning constantly over the experimentation period ➢ FLE promotes healthy decisions & quality decisions ➢ Farmers conduct their own field studies with comparisons or treatments ➢ Facilitates Farmer-to-Farmer communication ➢ Field staff serve as facilitators ➢ FLE is a unique way to educate farmers ➢ It is an effective platform for sharing of experiences and collectively solving agriculture related problems. 5. Expert system Expert system is an intelligent computer program that uses knowledge and inferences procedures to solve problems (Daniel Hunt, 1986). Objectives of developing expert system ➢ To enhance the performance of agricultural extension personnel and farmer ➢ To make farming more efficient and profitable ➢ To reduce the time required in solving the problems ➢ To maintain the expert system by continuously upgrading the database Advantages of expert system ➢ Solves critical problems by making logical deductions without taking much time ➢ It combines experimental and conventional knowledge with the reasoning skills of specialists ➢ To enhance the performance of average worker to the level of an expert Limitations of expert system ➢ Expensive computer program ➢ Mostly developed not in regional languages ➢ Requires AC power and internet connection all the time ➢ Complex software requires computer skilled personnel Modules of expert system in agriculture ➢ COMAX: Integrated crop management in cotton ➢ SOYEX: Soybean oil extraction expert system ➢ PLANT/ds: Diagnosis of soybean diseases ➢ MAIZE: Maize expert system for field crop management ➢ SEMAGI: Weed control decision making in sunflowers ➢ Rice Crop Doctor: Developed by National Institute of Agricultural Extension Management (MANAGE) Difference between conventional and expert system of extension Conventional Extension ➢ Universal approachability of same information is a problem ➢ Information is given whatever is available without considering needs and resources ➢ No Cost benefit analysis ➢ Information flow depends on availability of agent ➢ Require users to draw their own conclusion from facts Expert System of Extension ➢ Universal approachability of same information is possible ➢ Information is chosen based on their needs and resources ➢ Cost benefit analysis ➢ Information through Cyber Cafe at any place at any time ➢ Conclusion is drawn based on the decision given by the expert

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94

The difference between mental and physical action

• The difference between hardware and software • The difference between input and output devices • Why folders are important • How to use File Explorer • What ‘the cloud’ is

The difference between Primary, Appeal and Supreme courts

The difference between the probability independent event and dependent event

The difference between description and narration in writing

Related quizzes

Related quizzes