What is the primary purpose of a rubric?

To provide consistent evaluation criteria

Which of the following best describes the structure of a rubric?

Criteria and performance levels

Which of the following best describes the concept of reliability in alternative assessment instruments?

The consistency of results produced by the assessment.

The range of content covered by the assessment.

The accuracy of the assessment in measuring student learning.

The process of grading assessments fairly.

What factor is essential for ensuring the validity of an alternative assessment?

Clear alignment between assessment tasks and specific learning objectives.

Standardized grading rubrics for all assessments.

A variety of question types to engage students.

The use of technology to facilitate the assessment process.

Quiz-Alternative Assessment

Alternative Assessment Quiz.

Rubric development & Validity and reliability in Alternative Assessment - Quiz

quiz chapters 5 & 6 Alternative Assessment

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

Vocab quiz choosing alternative fuel

ChatGPT Quiz: Basics of Alternative & OpenSource Software #1

Unit 5 (Natural Resources & Alternative Energy) Vocabulary Quiz

Can you make me a 40 question quiz from the following information? he story of coffee has all the elements of a bestselling novel, such as chance happenings, luck, political intrigue, the high seas and great wealth. With research, you will find many stories and dates when this happened and dates when that happened. Often these stories and dates will conflict with each other. Whatever the history, coffee has become one of the most important trading commodities in the world. Being second only to oil and being one of the most popular beverages, behind tea, beer and of course, water. Coffee growing is a very labour-intensive operation and it provides important trading income for many nations and people throughout the world. The most famous story about the origin of coffee is the story of Kaldi a goat herder from Ethiopia. It is said he noticed that his goats became very active after eating the red berries of a certain plant. He tried a few himself and noticed the stimulating effect of the berries. It is then said that monks started drinking a beverage made from the berries to help stay awake for the prayers; this would have been around 1000 AD. Over the next few hundred years the Arab world started to use the berries as a beverage and coffee was born. In those early years, coffee was mostly confined to the Muslim world with the export of coffee plants and seeds banned. But coffee could not be hidden forever so eventually coffee was introduced to Constantinople and coffee houses were opened in 1475. European traders then brought coffee back to Europe by approximately 1600. At first, coffee was met with a hostile reaction, with some Christians calling it the ‘Devil’s Drink’ and asking Pope Vincent III to ban the beverage. He tried coffee and liked it so much that he is claimed to have said “This beverage is so delicious that it would be a sin to let only misbelievers drink it! Let’s defeat Satan by blessing this beverage, which contains nothing objectionable to a Christian!” Coffee shops sprung up in every city and became an important social and networking place to meet. This tradition continues today with the French word for coffee being ‘Café’. Coffee is said to have changed the social fabric of society by providing a popular non-alcoholic alternative to beer and wine. For the first time in recorded history people were not drunk all the time. Coffee today is grown and enjoyed worldwide and is one of the few crops that small farmers in third-world countries can profitably export. The coffee plant is a tree that is pruned to grow to a height of approximately three metres. This makes cultivating the beans easier as most of the beans are handpicked. The plant has white flowers similar to jasmine that grow in clusters and set to become red cherry-like fruit; beneath the red skin are two pips which are the coffee beans. Because the berries ripen at varying times the fruit must be handpicked to select only those beans ripe for harvest. This requires the picker to pick from the same plant many times and is very labour intensive. This is why coffee is grown in developing countries where labour is cheaper and foreign income is needed. Coffee plants grow best in a mountain tropical climate between the Tropic of Capricorn and the Tropic of Cancer. This mountainous land is another reason why machine picking is very difficult and hand picking is preferred. There are two main species of coffee grown today: Coffee Arabica. Coffee Robusta. Robusta grows at lower altitudes and produces a larger crop than Arabica; therefore, it is cheaper to produce Arabica is the most popular and generally considered to give superior flavour. Most Robusta is grown in Asia and Africa. About 75% of coffee grown is Arabica and 25% Robusta. Robusta is more often used as a blend with Arabica rather than a standalone coffee; used as a filler coffee in the production of instant or to add extra caffeine to an Arabica coffee for the European markets. Robusta is higher in caffeine than Arabica, but the flavour is not as palatable as the more popular Arabica bean. Coffee is produced in about 60 countries throughout the world but production is dominated by three countries producing approximately half the crop: Brazil, Vietnam and Colombia.

Related quizzes

Related quizzes