Test Run 2 | Quizalize

Based on the text "Eating colours every day," here is a set of multiple-choice questions using "Wh-" question words (Who, What, Where, When, Why) to test comprehension: Comprehension Quiz: Eating Colours 1. What does the phrase "eating colours" actually mean? A) Eating food with artificial food coloring. B) Choosing a variety of colorful fruits and vegetables. C) Painting your food before you eat it. D) Only eating your favorite color of food. 2. Why should we eat different colours every day? A) To make the plate look pretty for photos. B) Because colorful food tastes sweeter. C) To get different vitamins and minerals that help us stay healthy. D) Because it is easier to cook colorful food. 3. When can you try to include many colours in your diet? A) Only on the weekends. B) Once a month. C) Only for dinner. D) Throughout the day in all your meals. 4. What is a specific benefit mentioned for our bodies when we eat these foods? A) They help us run faster than a car. B) They help our bodies grow, stay strong, and fight illness. C) They change our eye color. D) They help us sleep for 12 hours. 5. Which of these is an example of a "purple" food mentioned for dessert? A) Red peppers B) Dates C) Purple grapes D) Carrot soup 6. What "Wh-" category does the carrot soup fall into for the suggested daily menu? A) What you eat for breakfast. B) What you eat for lunch. C) What you eat for dessert. D) What you eat for a midnight snack.

1. Flammable materials, like alcohol, should never be dispensed or used near A. an open door. B. an open flame. C. another student. D. a sink. 2. If a laboratory fire erupts, immediately A. notify your instructor. B. run for the fire extinguisher. C. throw water on the fire. D. open the windows. 3. Approved eye protection devices (such as goggles) are worn in the laboratory A. to avoid eye strain. B. to improve your vision. C. only if you don’t have corrective glasses. D. any time chemicals, heat or glassware are used. 4. If you wear contact lenses in the school laboratory, A. take them out before starting the lab. B. you do not have to wear protective goggles. C. advise your science instructor that you wear contact lenses. D. keep the information to yourself. 5. If you do not understand a direction or part of a lab procedure, you should A. figure it out as you do the lab. B. try several methods until something works. C. ask the instructor before proceeding. D. skip it and go on to the next part. 6. After completing an experiment, all chemical wastes should be A. left at your lab station for the next class. B. disposed of according to your instructor’s directions. C. dumped in the sink. D. taken home. 7. If a lab experiment is not completed, you should A. discuss the issue with your instructor. B. sneak in after school and work alone. C. come in during lunch and finish while eating lunch. D. make up some results. 8. You are heating a substance in a test tube. Always point the open end of the tube A. toward yourself. B. toward your lab partner. C. toward another classmate. D. away from all people. Science Laboratory Safety teSt 9. You are heating a piece of glass and now want to pick it up. You should A. use a rag or paper towels. B. pick up the end that looks cooler. C. use tongs. D. pour cold water on it. 10. You have been injured in the laboratory (cut, burn, etc.). First you should A. visit the school nurse after class. B. see a doctor after school. C. tell the science instructor at once. D. apply first aid yourself. 11. When gathering glassware and equipment for an experiment, you should A. read all directions carefully to know what equipment is necessary. B. examine all glassware to check for chips or cracks. C. clean any glassware that appears dirty. D. All of the above. 12. You want to place a piece of glass tubing into a rubber stopper after the tubing has been fire polished and cooled. This is best done by A. lubricating the tubing with water or glycerin. B. using a towel or cotton gloves for protection. C. twisting the tubing and stopper carefully. D. all of the above. 13. Personal eyeglasses provide as much protection as A. a face shield. B. safety glasses. C. splashproof chemical goggles. D. none of the above. 14. Long hair in the laboratory must be A. cut short. B. held away from the experiment with one hand. C. always neatly groomed. D. tied back or kept entirely out of the way with a hair band, hairpins, or other confining device. 15. In a laboratory, the following should not be worn. A. loose clothing. B. dangling jewelry. C. sandals. D. all of the above. 16. The following footwear is best in the laboratory. A. sandals B. open-toed shoes C. closed-toed shoes D. shoes appropriate for the weather3 © 2017 Flinn Scientific, Inc. All Rights Reserved. 17. Horseplay or practical jokes in the laboratory are A. always against the rules. B. okay. C. not dangerous. D. okay if you are working alone. 18. If a piece of equipment is not working properly, stop, turn it off, and tell A. the custodian. B. your lab partner. C. your best friend in the class. D. the science instructor. 19. If an acid is splashed on your skin, wash at once with A. soap. B. oil. C. weak base. D. plenty of water. 20. When you finish working with chemicals, biological specimens, and other lab substances, always A. treat your hands with skin lotion. B. wash your hands thoroughly with soap and water. C. wipe your hands on a towel. D. wipe your hands on your clothes. True—False T F 22. ■ ■ Hot glass looks the same as cold glass. 23. ■ ■ All chemicals in the lab are to be considered dangerous. 24. ■ ■ Return all unused chemicals to their original containers. 25. ■ ■ Work areas should be kept clean and tidy. 26. ■ ■ Pipets are used to measure and dispense small amounts of liquids. You should draw the liquid into the pipet using your mouth. 27. ■ ■ Laboratory work can be started immediately upon entering the laboratory even if the instructor is not yet present. 28. ■ ■ Never remove chemicals or other equipment from the laboratory. T F 29. ■ ■ Chipped or cracked glassware is okay to use. 30. ■ ■ Read all procedures thoroughly before entering the laboratory. 31. ■ ■ All unauthorized experiments are prohibited. 32. ■ ■ You are allowed to enter the chemical preparation/storage area any time you need to get an item. 33. ■ ■ Laboratory aprons should be worn during all lab activities. 34. ■ ■ It’s okay to pick up broken glass with your bare hands as long as the glass is placed in the trash. 35. ■ ■ Never leave a lit burner unattended. 21. Draw a diagram of your science room and label the locations of the following: ■ Fire Blanket ■ Fire Extinguisher(s) ■ Exits ■ Eyewash Station ■ Emergency Shower ■ Closest Fire Alarm Station ■ Waste Disposal Container(s)4 © 2017 Flinn Scientific, Inc. All Rights Reserved. Name: ________________________________________________ Date: ______________________________________________ 1. Flammable materials, like alcohol, should never be dispensed or used near A. an open door. B. an open flame. C. another student. D. a sink. 2. If a laboratory fire erupts, immediately A. notify your instructor. B. run for the fire extinguisher. C. throw water on the fire. D. open the windows. 3. Approved eye protection devices (such as goggles) are worn in the laboratory A. to avoid eye strain. B. to improve your vision. C. only if you don’t have corrective glasses. D. any time chemicals, heat or glassware are used. 4. If you wear contact lenses in the school laboratory, A. take them out before starting the lab. B. you do not have to wear protective goggles. C. advise your science instructor that you wear contact lenses. D. keep the information to yourself. 5. If you do not understand a direction or part of a lab procedure, you should A. figure it out as you do the lab. B. try several methods until something works. C. ask the instructor before proceeding. D. skip it and go on to the next part. 6. After completing an experiment, all chemical wastes should be A. left at your lab station for the next class. B. disposed of according to your instructor’s directions. C. dumped in the sink. D. taken home. 7. If a lab experiment is not completed, you should A. discuss the issue with your instructor. B. sneak in after school and work alone. C. come in during lunch and finish while eating lunch. D. make up some results. 8. You are heating a substance in a test tube. Always point the open end of the tube A. toward yourself. B. toward your lab partner. C. toward another classmate. D. away from all people. Science Laboratory Safety teSt 9. You are heating a piece of glass and now want to pick it up. You should A. use a rag or paper towels. B. pick up the end that looks cooler. C. use tongs. D. pour cold water on it. 10. You have been injured in the laboratory (cut, burn, etc.). First you should A. visit the school nurse after class. B. see a doctor after school. C. tell the science instructor at once. D. apply first aid yourself. 11. When gathering glassware and equipment for an experiment, you should A. read all directions carefully to know what equipment is necessary. B. examine all glassware to check for chips or cracks. C. clean any glassware that appears dirty. D. All of the above. 12. You want to place a piece of glass tubing into a rubber stopper after the tubing has been fire polished and cooled. This is best done by A. lubricating the tubing with water or glycerin. B. using a towel or cotton gloves for protection. C. twisting the tubing and stopper carefully. D. all of the above. 13. Personal eyeglasses provide as much protection as A. a face shield. B. safety glasses. C. splashproof chemical goggles. D. none of the above. 14. Long hair in the laboratory must be A. cut short. B. held away from the experiment with one hand. C. always neatly groomed. D. tied back or kept entirely out of the way with a hair band, hairpins, or other confining device. 15. In a laboratory, the following should not be worn. A. loose clothing. B. dangling jewelry. C. sandals. D. all of the above. 16. The following footwear is best in the laboratory. A. sandals B. open-toed shoes C. closed-toed shoes D. shoes appropriate for the weather5 © 2017 Flinn Scientific, Inc. All Rights Reserved. 17. Horseplay or practical jokes in the laboratory are A. always against the rules. B. okay. C. not dangerous. D. okay if you are working alone. 18. If a piece of equipment is not working properly, stop, turn it off, and tell A. the custodian. B. your lab partner. C. your best friend in the class. D. the science instructor. 19. If an acid is splashed on your skin, wash at once with A. soap. B. oil. C. weak base. D. plenty of water. 20. When you finish working with chemicals, biological specimens, and other lab substances, always A. treat your hands with skin lotion. B. wash your hands thoroughly with soap and water. C. wipe your hands on a towel. D. wipe your hands on your clothes. 21. Draw a diagram of your science room and label the locations of the following: ■ Fire Blanket ■ Fire Extinguisher(s) ■ Exits ■ Eyewash Station ■ Emergency Shower ■ Closest Fire Alarm Station ■ Waste Disposal Container(s) True—False T F 22. ■ ■ Hot glass looks the same as cold glass. 23. ■ ■ All chemicals in the lab are to be considered dangerous. 24. ■ ■ Return all unused chemicals to their original containers. 25. ■ ■ Work areas should be kept clean and tidy. 26. ■ ■ Pipets are used to measure and dispense small amounts of liquids. You should draw the liquid into the pipet using your mouth. 27. ■ ■ Laboratory work can be started immediately upon entering the laboratory even if the instructor is not yet present. 28. ■ ■ Never remove chemicals or other equipment from the laboratory. T F 29. ■ ■ Chipped or cracked glassware is okay to use. 30. ■ ■ Read all procedures thoroughly before entering the laboratory. 31. ■ ■ All unauthorized experiments are prohibited. 32. ■ ■ You are allowed to enter the chemical preparation/storage area any time you need to get an item. 33. ■ ■ Laboratory aprons should be worn during all lab activities. 34. ■ ■ It’s okay to pick up broken glass with your bare hands as long as the glass is placed in the trash. 35. ■ ■ Never leave a lit burner unattended.

What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

Test run

Related quizzes

Related quizzes