Devonte just came from the beach.

Devonte just come back from his friend’s house.

Devonte just came from a camping trip.

Devonte just came from the local surf shop.

The characters are going fishing.

The characters are going to Larry’s house.

The characters are going to look for worms.

The characters are going to a restaurant.

Angelica and her mother are preparing for Thanksgiving dinner.

Angelica and her mother are preparing to make cranberry juice.

Angelica and her mother are preparing for Angelica’s birthday party.

Angelica and her mother are preparing to clean the attic.

The setting is the school cafeteria.

The setting is the school kitchen.

The setting is the school auditorium.

The setting is the school’s stage.

The boys are preparing for a soccer game.

The boys are preparing for a basketball game.

The boys are preparing for a fishing trip.

Emilio is late for his brother’s wedding.

Emilio is late for his school’s dance.

Emilio is late for his job as a taxi driver.

Emilio is late for his job at the dry cleaners.

Noe is afraid of drinking soda.

It’s the narrator’s first cruise, and he or she is seasick.

It’s the narrator’s first cruise, and he or she is at the beach.

It’s the narrator’s first cruise, and he or she is bored.

It’s the narrator’s first cruise, and he or she is homesick.

The animal being described is a bear.

The animal being described is a fish.

The animal being described is an eagle.

The animal being described is a person.

Linus just came from his job at an ice cream shop.

Linus just came from his job at a sprinkle factory.

Linus just came from his job at a polo shirt store.

Linus just came from his job at a bicycle shop.

The season is fall, and the month is October.

The season is spring, and the month is April.

The season is winter, and the month is December.

The season is fall, and the month is November.

The fines are for overdue library books.

The fines are for checking out too many books.

The fines are for being too loud in the library.

The fines are for dropping her books.

Inference Task Cards #1-12

The challenges of working in the new economy recognize: 1.1 Working Today Talent Talented people- What they know, what they learn and what they can achive The source of organisational performance Develop skills and improve What is intellectual capital The combined brain power and shared knowledge of an organization's employees TO orginzations: Intellectual capital resents a strategic asset as human creativity, insight and decision making can be converted into superior performance To individuals: Intellectual capital is a personal asset, one to be nurtured and continually updated Things evolve, make sure we keep updated Intellectual capital: The package on intellect skills and capabilities that set us apart making us valable to potential employers Maintaining your talent: There is no escaping the fact that your career success will require a lot of initiative, self awareness and continuous learning Technology Tech is in our everyday lives Latest developments Smart phone, smart apparel, smart cars, smart homes We struggle to keep up with social media ana staying connected with messaging, full of email and voicemail What happenings as younger workers advance into management Flexibility Work ethic It is critical to build and maintain a high Tech IQ! What is Tech IQ: The ability to use current technologies at work and in your personal life, combined with the commitment to keep yourself updated as technology continues to evolve Intellectual capi5la is a combination of: Commitment x Competency = Intellectual capital How to make the world a better place Globalisation The worldwide interdependence of resources flows, product markets and business competition Under the influence, government leaders worry and about the competitiveness of nations just as corporate leaders worry about business competitiveness Emerging markets will power global growth over the next 20 years. By 2025 overall global consumption is forecast to reach $62 trillion, twice its 2013 level and fully half of this increase will come from the emerging world Consequence: Going to fast in uses resources, inflation, corporate greed It's cheaper to have things made in different countries (wages are low and going down) Shamrock organization 1 leaf - full time employees- standard career paths 2 leaf - “freelancers” 3 leaf - Part times without benefits (first to lose their jobs when employers face economic difficulties) The rising of emerging markets Now account for 60% of all low and medium technology manufacturing worldwide Total value add in high tech manufacturing from a low 26% in the 1970s to 48% at present China strategy to upgrade its industries and move the manufacturing value ching by prioritising 10 sectors Information technology, robotic, aerospace, maritime equipment, modern railway equipment, alternative energy vehicles, power equipment, agriculture equipment, advanced materials, biopharma and medical products Ethics A code of moral principa;s that sets standards for conduct that is “good” and “right” as well as “bad” and “wrong” Enron company huge corruption even in elections same thing happened with The Mechanism 1.2 - Organizations Organizational Purpose An orgnizations is a collection of people working together to achieve a common purpose Unique social phenomenon that enables its members to perform tasks far beyond the reach of individual accomplishment (synergy) The broad purpose of any orginzation is to provide goods or services of value to customers and clients A clear sense of purpose tied to: Quality of products and services Customer satisfaction Social responsibility Can be an important source of organisational strength and performance advantage All organisations are open systems (Systems that interact with its environment for renewal and growth) Organizations as systems All organizations are open systems that interact with their environment Continual process of obtaining resource inputs-people, information, resources and capital- and transforming them into outputs in the form of finished goods and services for customers One simple way to assess the impact of any organisation is to ask the question: How is the world different because it existed Michal Porter - Value Chain Value Creation: Organisations create value when they use resources well to produce good products and take care of their customers One simple way to assess the impact of any organization is to ask the questions: How is the world different because it existed? Triple Bottom Line The 3 Ps of organizational performance Profit - is the decision economically sound? People - Does the decision treat people with respect and dignity? Planet - Is the decision good for the environment? Organizational Performance Productivity: An overall measure of the quantity and quality of work performance with recourse utilisation taken into account Performance effectiveness: An output measure of task or goal accomplishment Performance efficiency: An input measure of the resource costs associated with goal accomplishment. Workplace changes that impact management Focus on valuing human capital Demise of “Command and control” Emphasis on teamwork Pre-eminence of technology New workforce expectations Importance of networking Concern for sustainability 1.3 Managers Importance of human resources and manger People are not ‘costs to be controlled’ High performing organizations treat people as valuable strategic assets Three takeaways 1. Give leaders broad authority 2. Encourage them to think like CEO 3. Challenge strong performers easily with big opportunities Direct support, supervise and help activate the work efforts of others The people who managers help are the ones whose contributions represent the real work of the organisation Levels of management Types of managers Line managers are responsible for work activities that directly affect organization’s output Staff managers use technical expertise to advise and support the efforts of line workers Functional managers are responsible for a single area of activity Quality of work life (QWL) An indicator of the overall quality of human experiences in the workplace QWL Indicators Respect Fair pay Safe working conditions Opportunities to learn and use new skills Room to grow and progress in a career Protection of individuals rights The organization as an upside-down pyramid A manager’s job is to support worker’s efforts The best managers are known for helping and supporting Customers at the top served by worker who are supported by managers 1.4 The management Process Managers achieve high performance for their organizations by best utilizing its humans and material resources Management is the process of planning, organizing, leading and controlling the use of resources to accomplish performance goals All managers are responsible for the four functions The functions are carried on continually Four functions: Planning,organizing, leading and controlling Mintzberg’s 10 Managerial Roles Characteristics of managerial work Long hours Intense pace Fragmented and varied tasks Many communication media Filled with interpersonal relationships Managerial agendas and networks Agenda setting Develops action priorities for accomplishing goals and plans Networking Process of building and maintaining positive relationships with people who can help advance agendas Social Capital Capacity to attract support and help from others Learning The change in a behaviour that results from experience Lifelong learning The process of continuously learning from daily experiences and opportunities Katz’ Essential Managerial Skills

Chapter One: Management Today The challenges of working in the new economy recognize: 1.1 Working Today Talent Talented people- What they know, what they learn and what they can achive The source of organisational performance Develop skills and improve What is intellectual capital The combined brain power and shared knowledge of an organization's employees TO orginzations: Intellectual capital resents a strategic asset as human creativity, insight and decision making can be converted into superior performance To individuals: Intellectual capital is a personal asset, one to be nurtured and continually updated Things evolve, make sure we keep updated Intellectual capital: The package on intellect skills and capabilities that set us apart making us valable to potential employers Maintaining your talent: There is no escaping the fact that your career success will require a lot of initiative, self awareness and continuous learning Technology Tech is in our everyday lives Latest developments Smart phone, smart apparel, smart cars, smart homes We struggle to keep up with social media ana staying connected with messaging, full of email and voicemail What happenings as younger workers advance into management Flexibility Work ethic It is critical to build and maintain a high Tech IQ! What is Tech IQ: The ability to use current technologies at work and in your personal life, combined with the commitment to keep yourself updated as technology continues to evolve Intellectual capi5la is a combination of: Commitment x Competency = Intellectual capital How to make the world a better place Globalisation The worldwide interdependence of resources flows, product markets and business competition Under the influence, government leaders worry and about the competitiveness of nations just as corporate leaders worry about business competitiveness Emerging markets will power global growth over the next 20 years. By 2025 overall global consumption is forecast to reach $62 trillion, twice its 2013 level and fully half of this increase will come from the emerging world Consequence: Going to fast in uses resources, inflation, corporate greed It's cheaper to have things made in different countries (wages are low and going down) Shamrock organization 1 leaf - full time employees- standard career paths 2 leaf - “freelancers” 3 leaf - Part times without benefits (first to lose their jobs when employers face economic difficulties) The rising of emerging markets Now account for 60% of all low and medium technology manufacturing worldwide Total value add in high tech manufacturing from a low 26% in the 1970s to 48% at present China strategy to upgrade its industries and move the manufacturing value ching by prioritising 10 sectors Information technology, robotic, aerospace, maritime equipment, modern railway equipment, alternative energy vehicles, power equipment, agriculture equipment, advanced materials, biopharma and medical products Ethics A code of moral principa;s that sets standards for conduct that is “good” and “right” as well as “bad” and “wrong” Enron company huge corruption even in elections same thing happened with The Mechanism 1.2 - Organizations Organizational Purpose An orgnizations is a collection of people working together to achieve a common purpose Unique social phenomenon that enables its members to perform tasks far beyond the reach of individual accomplishment (synergy) The broad purpose of any orginzation is to provide goods or services of value to customers and clients A clear sense of purpose tied to: Quality of products and services Customer satisfaction Social responsibility Can be an important source of organisational strength and performance advantage All organisations are open systems (Systems that interact with its environment for renewal and growth) Organizations as systems All organizations are open systems that interact with their environment Continual process of obtaining resource inputs-people, information, resources and capital- and transforming them into outputs in the form of finished goods and services for customers One simple way to assess the impact of any organisation is to ask the question: How is the world different because it existed Value Creation: Organisations create value when they use resources well to produce good products and take care of their customers One simple way to assess the impact of any organization is to ask the questions: How is the world different because it existed? The 3 Ps of organizational performance Profit - is the decision economically sound? People - Does the decision treat people with respect and dignity? Planet - Is the decision good for the environment? Productivity: An overall measure of the quantity and quality of work performance with recourse utilisation taken into account Performance effectiveness: An output measure of task or goal accomplishment Performance efficiency: An input measure of the resource costs associated with goal accomplishment. Workplace changes that impact management Focus on valuing human capital Demise of “Command and control” Emphasis on teamwork Pre-eminence of technology New workforce expectations Importance of networking Concern for sustainability 1.3 Managers Importance of human resources and manger People are not ‘costs to be controlled’ High performing organizations treat people as valuable strategic assets Three takeaways 1. Give leaders broad authority 2. Encourage them to think like CEO 3. Challenge strong performers ealy with big opportunities Direct support, supervise and help activate the work efforts of others The people who managers help are the ones whose contributions represent the real work of the organisation Types of managers Line managers are responsible for work activities that directly affect organization’s output Staff managers use technical expertise to advise and support the efforts of line workers Functional managers are responsible for a single area of activity Quality of work life (QWL) An indicator of the overall quality of human experiences in the workplace QWL Indicators Respect Fair pay Safe working conditions Opportunities to learn and use new skills Room to grow and progress in a career Protection of individuals rights The organization as an upside-down pyramid A manager’s job is to support worker’s efforts The best managers are known for helping and supporting Customers at the top served by worker who are supported by managers 1.4 The management Process Managers achieve high performance for their organizations by best utilizing its humans and material resources Management is the process of planning, organizing, leading and controlling the use of resources to accomplish performance goals All managers are responsible for the four functions The functions are carried on continually Characteristics of managerial work Long hours Intense pace Fragmented and varied tasks Many communication media Filled with interpersonal relationships Managerial agendas and networks Agenda setting Develops action priorities for accomplishing goals and plans Networking Process of building and maintaining positive relationships with people who can help advance agendas Social Capital Capacity to attract support and help from others Learning The change in a behaviour that results from experience Lifelong learning The process of continuously learning from daily experiences and opportunities

The Invention of the Automobile An automobile, or car, is a wheeled vehicle that carries its own motor and transports passengers. The automobile as we know it was not invented in a single day by a single inventor. In 1769, the French engineer Nicolas-Joseph Cagnon devised the first self-propelled road vehicle, a military tractor powered by a steam engine. One year later, Cagnon built a steam-driven tricycle that could carry four passengers, but steam engines were very heavy and they proved a poor design for road vehicles. Around 1830, the Scotsman Robert Anderson built the first electric carriage. Both steam and electric road vehicles were soon abandoned in favour of petrol-powered vehicles. In 1876, Nicolaus August Otto built the first practical four-stroke internal combustion engine. In an internal combustion engine, the fuel is burnt inside the engine, while in a steam engine, the fuel is burnt outside. The most common internal combustion engine type is petrol-powered. The first petrol-powered vehicles were developed by Gottlieb Daimler and Karl Benz. In 1885, Karl Benz designed the first three-wheeler powered by an internal combustion engine. In 1891, Benz built the first four-wheeler. The first automobile to be mass-produced in the USA was the 1901 curved-dashed Oldsmobile built by Ransom L.E. Odds. Odds devised the basic concept of the assembly line and started the Detroit-area automobile industry. Henry Ford installed the first conveyor belt-based assembly line in his car factory in Michigan in 1913. The assembly line reduced production costs for cars by reducing assembling time. Ford's famous Model T was assembled in 93 minutes. The Ford Motor Company was launched in 1903, and by 1927, 15 million Model Ts have been manufactured. The modern era of automobiles had begun. The assembly line During the period known as the Industrial Revolution (1760-1850) machines changed people’s lives as well as their methods of manufacturing. Most products people in the industrialized nations use today are manufactured by the process of mass production, that is by people and robots that use power-driven machines. Through the use of mass pro-duction methods and the assembly line, a larger amount of goods can be produced in a given period of time, usually at a lower cost.The assembly line developed at the Ford Motor Com-pany in 1913 had immense influence on the automo-tive industry and on other industrial branches. Henry Ford, founder of the company, had built his first car in 1896 and was unique among automobile inventors. In Ford’s early assembly line, cars were pulled by rope from one worker to the next. This new technique allowed individual workers to stay in one place and perform the same task repeatedly on vehi-cles as they passed by. This reduced production timeby about one-half. Ford later employed the use of conveyor belts to move the parts down the line.

Inference Task 2

What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94

We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?

Related quizzes

Related quizzes