Useful Instructions

Useful Instructions Cool Unit 1 הוראות שימושיות

Instructions: Please answer the following questions to test your understanding of aptitudes and interests. 1. What are Core Drivers (Talents) in the context of aptitudes and interests? a) Abilities that are developed through education b) Natural gifts that predict job effectiveness and contentment c) Interests that change over time d) Personality traits 2. Determine how effective and satisfied you'll be doing a particular kind of work. a) Visual Comparison Speed b) Numerical Reasoning c) Spatial Visualization d) Sequential Reasoning 3. Which Core Driver is associated with the knack for organizing things in a sequential and systematic manner? a) Visual Comparison Speed b) Numerical Reasoning c) Spatial Visualization d) Sequential Reasoning 4. What is the primary role of Space Planners in careers? a) They are responsible for interior design b) They read maps and blueprints c) They generate creative ideas d) They manage financial accounts 5. Which Core Driver relates to the ability to mentally translate two-dimensional images into three-dimensions? a) Visual Comparison Speed b) Numerical Reasoning c) Spatial Visualization d) Sequential Reasoning 6. What type of individuals are known as 3D Visualizers? a) Those who excel in visual art b) People who can quickly process numerical data c) Individuals who can mentally create 3D models from 2D representations d) Creative writers 7. How do Brainstormers differ from Concentrated & Focused individuals in terms of generating ideas? a) Brainstormers generate more ideas b) Concentrated & Focused individuals generate more ideas c) They generate ideas at the same rate d) Both groups struggle to generate ideas 8. What is the primary advantage of having high Visual Comparison Speed? a) It helps in artistic endeavors b) It is useful in complex mathematical problems c) It aids in tasks requiring clerical detail and accuracy d) It enhances spatial visualization 9. Which career is NOT associated with the Core Driver: Visual Comparison Speed? a) Fire Inspector b) Astronomer c) Creative Writer d) Orthoptist 10. What is the main focus of Numerical Reasoning? a) Identifying numerical patterns and trends b) Analyzing historical data c) Solving abstract problems d) Communicating effectively 11. Which Core Driver involves the ability to rapidly draw conclusions from seemingly unrelated pieces of information? a) Numerical Reasoning b) Idea Generation c) Spatial Visualization d) Inductive Reasoning 12. What is the primary characteristic of Diagnostic Problem Solvers? a) They follow a logical step-by-step method of problem-solving b) They rely on specific information and observed experience c) They intuitively leap to conclusions based on limited information d) They are meticulous and deliberate in decision-making 13. What is the role of Fact Checkers in the problem-solving process? a) They intuitively provide solutions b) They rely on specific information and observed experience c) They enjoy acquiring new information and learning d) They make conclusions based on limited facts 14. In what type of role are Abstract Thinkers most comfortable? a) Counseling b) Law c) Marketing d) Construction 15. How can understanding your Core Drivers benefit collaborative work? a) It allows individuals with similar aptitudes to work together more effectively b) It creates conflicts within the team c) It doesn't affect collaborative work d) It makes collaboration more challenging 16. Which Core Driver is associated with processing complex mathematical problems logically? a) Visual Comparison Speed b) Numerical Reasoning c) Sequential Reasoning d) Idea Generation 17. What are Collaborative Planners more likely to do in a team project? a) Lead the team b) Create individual pieces of a project c) Solve abstract problems d) Generate creative ideas 18. How can understanding your aptitudes and interests help you make informed career choices? a) It guarantees job satisfaction b) It allows you to align your career with your strengths c) It helps you choose any career at random d) It has no impact on career decisions 19. Which Core Driver affects whether your thoughts go in several directions at once or follow single ideas more readily? a) Visual Comparison Speed b) Numerical Reasoning c) Idea Generation d) Inductive Reasoning 20. What is the primary characteristic of Idea Contributors? a) They generate creative ideas b) They discuss the big picture and next steps c) They are highly focused and detailed d) They follow a logical step-by-step approach 21. What is the role of Space Planners in the problem-solving process? a) They intuitively provide solutions b) They rely on specific information and observed experience c) They quickly organize information d) They create abstract plans 22. Which Core Driver is linked to the ability to see relationships in seemingly unrelated pieces of information? a) Spatial Visualization b) Inductive Reasoning c) Idea Generation d) Visual Comparison Speed 23. Which career is NOT associated with the Core Driver: Numerical Reasoning? a) Statistician b) Survey Researcher c) Chef d) Actuary 24. What are Core Drivers, and why are they important in the context of aptitudes and interests? a) They are educational qualifications b) They are interests that change over time c) They are natural gifts that predict job effectiveness and contentment d) They are personality traits 25. How can understanding your Core Drivers benefit collaborative work? a) It allows individuals with similar aptitudes to work together more effectively b) It creates conflicts within the team c) It doesn't affect collaborative work d) It makes collaboration more challenging Answers: b) Natural gifts that predict job effectiveness and contentment a) Visual Comparison Speed d) Sequential Reasoning b) They read maps and blueprints c) Spatial Visualization c) Individuals who can mentally create 3D models from 2D representations a) Brainstormers generate more ideas c) It aids in tasks requiring clerical detail and accuracy c) Creative Writer a) Identifying numerical patterns and trends d) Inductive Reasoning c) They intuitively leap to conclusions based on limited information b) They rely on specific information and observed experience b) Law a) It allows individuals with similar aptitudes to work together more effectively b) Numerical Reasoning b) Create individual pieces of a project b) It allows you to align your career with your strengths c) Idea Generation b) They discuss the big picture and next steps c) They quickly organize information b) Inductive Reasoning c) Chef c) They are natural gifts that predict job effectiveness and contentment a) It allows individuals with similar aptitudes to work together more effectively

Classification of plants • Plants can be classified as cultivated and wild plants. • Both cultivated and wild plants are very useful to people, animals and the environment. 1. Cultivated plants: • Cultivated plants are plants grown by people for selling. • They can be grown in the field, vegetable garden, home garden and orchard. Classification of plants 2. Wild plants Wild plants are plants that grow on their own outside the garden, orchard or field. They have many uses such as: • Food for people and animals • Shelter • Source of fuel in form of firewood. • Examples include, grasses, msasa, yellow wood, mahogany, mopane Plant Nutrition • The presence of plant nutrients in the soil make them grow well. • The three major plant nutrients are nitrogen, phosphorus and potassium. Sources of plant nutrients • The source for plant nutrients are grouped into organic and inorganic sources. Organic sources of plant nutrients • These are found in nature. • They are natural materials such, decayed plant and animal matter which include: • Animal manure from cattle, sheep, goats, poultry and pigs. • Green manure • Legume crops like beans, peas and groundnuts. • Humus • These material sources may also be called natural fertilizers. Inorganic sources of plant nutrients • These are sources of plant nutrients made by people in industries. They include: • Compound fertilizers like compound A, B, C and D. • These have two or more nutrients. • Straight fertilizers like ammonium nitrate, single super phosphate and urea. • A straight fertilizer supplies a single or more nutrient to the crop. A straight fertilizer A Compound fertilizer Sources of N,P,K • Ammonium nitrate and Urea- contain nitrogen Double super Phosphate, Single super phosphate-contain phosphorus • Muriate of Potash contains Potassium 2 . Compound fertilisers -have two or three of the three major plant nutrients (N.P.K). N-nitrogen P-phosphorus K-potassium Examples Compound D Wednesday 17 May 2023 Revision exercise (Plant nutrition) 1 .Name the 3 plant nutrients needed by plants. 2. What are the 2 groups of plant nutrients sources? 3. Give 3 examples of organic sources of plant nutrients. 4. What is a straight fertilizer? 5. Compound fertilizer supplies ……………or ………………. Nutrients. Vegetable crops • A vegetable is any part of a plant that is eaten by humans as food part of a meal. • Vegetables are grouped and named according to the part that is eaten. • These are leaf, root, fruit, flower, bulb, tuber and legume vegetables. Leaf vegetables Types of veg Legume etable cropsvegetables Fruit vegetables Root, bulb and tuber Flower vegetables Cabbage Peas Tomato Root: carrots Cauliflower Rape Green beans Pepper Parsnip broccoli Spinach Melons Beetroot Tsunga Cucumber Bulb: onion Lettuce Squash Garlic kale Egg plant Leek chillies Tuber: Irish potato Wednesday 31 May 2023 Vegetable crops 1. What is a vegetable? 2. Which one is not a vegetable from the list below? a. Covo B. cabbage C. wheat D. tomato 3. Choose a vegetable which is not a fruit vegetable. a. tomato B. pepper C. kale D. egg plant 4. From which pair of vegetables do we eat the flower? A. cauliflower and garlic B. broccoli and cauliflower C. broccoli and rape D. cauliflower and pepper 5. Give one example of a vegetable belonging to each of the following groups. a. root b. legume c. bulb 6. Name any 5 groups of vegetable classification according to the parts eaten. Growing leaf vegetables • Although there are many types of vegetables, the leaf, fruit and bulb vegetables are widely grown. • Leaf vegetables form the greater part of vegetable crops. • Leaf vegetables belong to a family called brassica. • Brassicas include cabbages, lettuce, spinach, covo and many others. • Each brassica family has got its own varieties called cultivar. • They usually grow under the same climatic conditions and are affected by the same pests and diseases. • The selection of a variety depends on the following : The intended use of the vegetable, for example, salad, stew or snacks. Days taken to mature. Disease resistant Season of the year Seedbed preparation • Brassica vegetables are usually raised in seedbeds. • The seedbeds are prepared by: • Marking the position of the bed 1 meter in width by any length using a tape measure, hammer and pegs. • Digging a seedbed to a depth of 25 to 30cm using a hoe. • Breaking lumps of soil using a garden rake. Soil requirements • Brassicas need: • Well drained soils. • Fertile soil for good growth • Slightly acidic soils (pH 5.5-6) Climatic requirements • Brassicas need cool to warm temperatures. • Very low temperatures cause cabbages to flower which is called bolting. • Brassicas can be grown throughout the year. Seedbed preparation • Brassica seedlings are usually raised in seedbeds. • A seedbed is prepared by: Marking the position of the bed 1 metre in width by any length using a tape measure, hammer and pegs. Digging a seedbed to depth of 25 to 30 cm using a hoe. Breaking lumps of soil using a garden rake. This is done in order to have a fine tilth and improve soil to seed contact. Making ridges that a 15cm high. Apply 3 to 5kg/m² of well decomposed manure. 60 to 100g/m² of compound fertilizer can be added into the soil. Management of vegetable crops • After transplanting the seedlings, the seedlings need to be looked after. (a)Controlling weeds: all vegetables must be kept weed free. • This is done either by hand pulling weeds or shallow cultivation using a hand fork. (b) Pest control: common pests that affect the brassicas are aphids and diamond black moth larva. • Aphids are small green insects that suck the juice from the leaves leaving them with curls. • They are controlled by spraying malathion using the instructions on the label. (c) Disease control: bacterial diseases are common in brassicas. • Common diseases are black rot and soft rot, especially in cabbages. • These are controlled by: Crop rotation Early planting Planting resistant cultivars (d) Top dressing: brassicas are top dressed using Ammonium Nitrate at a rate of 2.5g per plant. • Top dressing is usually done 3 or 4 weeks after germination. FIELD CROPS • Field crops are crops that are grown on a large piece of land. • Example of field crops:  Maize  Cotton  Groundnuts  Roundnuts  Wheat  Sunflower  Tobacco  Sugar cane  Tea  Coffee  Soya beans  sorghum Classification of field • Field crops can be classified according to use such crops cereal, fibre, sugar and oil. 1. Cereal crops: • A cereal is a grass grown for its edible seeds. • They are also known as grain crops. • The major cereal crops are maize, wheat, rice, barley, sorghum and millet. 2 . fiber crops : • these are crops which are grown for their fiber and are used in making textiles, ropes and rugs. • Important fiber crops are cotton, flax and sisal 3. Oil seed crops: • These crops are grown for the purpose of extracting oil from their seed. • The main oil seed crops are groundnuts, sunflower, soyabean and cotton seed. 4 . Sugar crops : • Sugar crops include sugarcane,

What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

Useful vocab for writing exam

Related quizzes

Related quizzes