Loading...
TESTING ED
Quiz by Ed
Customize this quiz to suit your class
Instantly translate to 100+ languages
Tag the questions with any skills you have. Your dashboard will track each student's mastery of each skill.
A
A
D
B
C
B
B
A
C
D
A
B
C
Give this quiz to my class
EDDY CURRENT TESTINGFor Computer Education TestingHere is a short and easy-to-read multiple-choice quiz on ethical considerations when using AI in education: --- **1. Why is it important to ensure AI tools in education are transparent?** a) To make AI tools more complex b) To build trust and accountability c) To reduce the number of users d) To increase costs --- **2. What should teachers consider when using AI to analyze student data?** a) Only the accuracy of the AI tool b) Students' privacy and data security c) The speed of analysis d) The AI's popularity --- **3. Which is a potential ethical issue with AI-based personalized learning?** a) Making learning easier b) Creating unfair advantages c) Improving student engagement d) Reducing teacher workload --- **4. How can bias in AI education tools be addressed?** a) Ignore the bias b) Continuously monitor and update the AI c) Use the AI without testing d) Focus only on the final outcomes --- **5. Why is it crucial to involve students in discussions about AI in education?** a) To keep them busy b) To make them more dependent on AI c) To ensure they understand the impact on their learning d) To avoid teaching them other subjects --- This quiz is designed to help assess the trainees' understanding of key ethical considerations when using AI in education.7.012 Employee Health The Center provides a safe working environment for all employees through a collaborative effort with them and the organization’s infection control program to identify infectious conditions that may put staff, patients and visitors at risk. Health evaluations, immunity testing for measles, mumps rubella and chickenpox, tuberculosis screening and immunity testing for hepatitis B and if not immune either signs declination form or accepts 3 dose vaccine series. (Rrefer to the Employee and Occupational Health Section policy Chapter 3.21) It is the center’s policy to monitor Health Care Associated Infections (HAI) in patients and personnel working in the Center as part of its ongoing program in Infection Prevention and Control. Staff should be encouraged to stay home when they have signs and symptoms of an infectious disease. If a staff develops signs and symptoms while at work, the person of other personnel and patients who may have been exposed to a staff member with a communicable disease should be taken into consideration. Patients and personnel can be told that they were exposed to a certain disease without disclosing the index case’s identity. In addition we work together to provide an annual influenza vaccination program that includes all staff who have patient contact, and licensed independent practitioners. Environmental Rounds - Environmental rounds are performed daily by assigned staff members, ie. “safety officer”. Feedback on opportunities for improvement is given to the Infection Control Coordinator and QAPI committee and then reported to the board Education – Employee education includes: General information about infections Techniques for prevention, surveillance, investigation and control Review of policies and procedures related to infection control: (See attachment B, policy and procedure reference list) Employee health practices; refer to Administration 3.16 Orientation and Training Offer of Hepatitis B vaccination & post exposure evaluations Annual TB skin testing Provides access to influenza vaccinations. Educates staff and licensed independent practitioners about influenza vaccination; non-vaccine infection control measures (such as the use of Droplet Precautions); and diagnosis, transmission, and potential impact of influenza. Annually evaluates vaccination participation and non-participation in the influenza immunization program and reports to Department of Health. Mission To prepare our students for a lifetime of endless potential. We accomplish this by: Preparing students for university transfer through academically rigorous programs grounded in the liberal arts tradition of William & Mary Expanding access to college credentials through strategic partnerships, specialized programming, and scalable innovation. Values A Friendly Family Atmosphere It is a constant theme that emanated from faculty, staff, and students. It is the comfort, the warmth, the family feeling that permeates the campus. An expansive atmosphere of support that allows all members of the college to uncover and act on their inherent potential. The atmosphere is valued, and it is embedded at the very core of the college. Enthusiastic Student Focused Service Ask any faculty of staff member at RBC why they come to work on any given day, and a single answer will resound: STUDENTS. We value that our mission centers on the success of our student body, and we endeavor to provide service of the highest quality to support their journey to success. Processes and proceeded are built, assessed, and improved in the name of the student, and we agree that nurturing that potential is our sole purpose. The Power of Difference Difference comes in many forms: the diversity of our campus population; the myriad ways that problems can be solved and risks mitigated; the various methods in which students learn and can be supported; the entrepreneurial spirit and nimbleness of faculty and staff. RBC continually stives to build an inclusive and welcoming community of individuals with diverse talents and skills from multitude of backgrounds who are committed to civility, mutual respect, and the free and open exchange of ideas. We value these differences because each new exchange expands out collective breadth of experience and knowledge and makes us stronger and better than we were. Building Confidence The dramatic transformation that occurs in students between Welcome Week and Commencement is incremental but astounding. Students move from the general idea of college education to fully formulated plans that include academic majors, professional goals, and transfer programs that strategically align their skills and dreams. Faculty and staff grow personally and professionally, and they hit stride on their career goals as they interact and engage with the campus. We value that RBC is a place where every individual can assist another human being in reaching the next stage of their life and career with newly discovered confidence or cultivate their own individual potential and fortitude. Quality Outcomes In the end the result matter and the faculty, staff and students of RBC value that we do our best to be the best. Through rigorous processes of assessment and adjustment, strategic change is continuously pursued to ensure that every outcome is of the highest quality, and that every initiative uses the efforts and resources of the College responsibly and efficiently. Vision As an extension of William & Mary, Richard Bland College is in the vanguard of learning-outcomes based liberal arts education for university transfer and a model for testing and applying outcomes-driven solutions in higher education.Owls, such as the young snowy owls on the previous page, have for centuries been symbols of both wisdom and mystery. To many cultures their piercing eyes have conveyed a look of intelligence. Their silent flight through darkened landscapes in search of prey has projected an air of power or wonder. For this chapter and this book, owls are an engaging example of a living organism from the world of biology—the study of life. BIOLOGY AND YOU Living in a small town, in the country, or at the edge of the suburbs, one may be lucky enough to hear an owl's hooting. This experience can lead to questions about where the bird lives, what it hunts, and how it finds its prey on dark, moonless nights. Biology, or the study of life, offers an organized and scientific framework for posing and answering such questions about the natural world. Biologists study questions about how living things work, how they interact with the environment, and how they change over time. Biologists study many different kinds of living things ranging from tiny organisms, such as bacteria, to very large organisms, such as elephants. Each day, biologists investigate subjects that affect you and the way you live. For example, biologists determine which foods are healthy. As shown in Figure 1-1, everyone is affected by this impor- tant topic. Biologists also study how much a person should exer- cise and how one can avoid getting sick. Biologists also study what CHARACTERISTICS OF LIFE The world is filled with familiar objects, such as tables, rocks, plants, pets, and automobiles. Which of these objects are living or were once living? What are the criteria for assigning something to the living world or the nonliving world? Biologists have established that living things share seven characteristics of life. These characteristics are organization and the presence of one or more cells, response to a stimulus (plural, stimuli), homeostasis, metabolism, growth and development, reproduction, and change through time. Organization and Cells Organization is the high degree of order within an organism’s internal and external parts and in its interactions with the living world. For example, compare an owl to a rock. The rock has a spe- cific shape, but that shape is usually irregular. Furthermore, differ- ent rocks, even rocks of the same type, are likely to have different shapes and sizes. In contrast, the owl is an amazingly organized individual, as shown in Figure 1-2. Owls of the same species have the same body parts arranged in nearly the same way and interact with the environment in the same way. Copyright © by Holt, Rinehart and Winston. All rights reserved. ORGANISM (Barn Owl) ORGAN (Owl’s Ear) TISSUE (Nervous Tissue Within the Ear) CELL (Nerve Cell) your air, land, and fAll living organisms, whether made up of one cell or many cells, have some degree of organization. A cell is the smallest unit that can perform all life’s processes. Some organisms, such as bacteria, are made up of one cell and are called unicellular (YOON-uh-SEL-yoo-luhr) organisms. Other organisms, such as humans or trees, are made up of multiple cells and are called multicellular (MUHL-ti-SEL-yoo-luhr) organisms. Complex multicellular organisms have the level of orga- nization shown in Figure 1-2. In the highest level, the organism is made up of organ systems, or groups of specialized parts that carry out a certain function in the organism. For example, an owl’s ner- vous system is made up of a brain, sense organs, nerve cells, and other parts that sense and respond to the owl’s surroundings. Organ systems are made up of organs. Organs are structures that carry out specialized jobs within an organ system. An owl’s ear is an organ that allows the owl to hear. All organs are made up of tissues. Tissues are groups of cells that have similar abilities and that allow the organ to function. For example, nervous tissue in the ear allows the ear to detect sound. Tissues are made up of cells. A cell must be covered by a membrane, contain all genetic information necessary for replication, and be able to carry out all cell functions. Within each cell are organelles. Organelles are tiny structures that carry out functions necessary for the cell to stay alive. Organelles contain biological molecules, the chemical compounds that provide physical structure and that bring about movement, energy use, and other cellular functions. All biological molecules are made up of atoms. Atoms are the simplest particle of an ele- ment that retains all the properties of a certain element. Response to Stimuli Another characteristic of life is that an organism can respond to a stimulus—a physical or chemical change in the internal or external environment. For example, an owl dilates its pupils to keep the level of light entering the eye constant. Organisms must be able to respond and react to changes in their environment to stay alive. ORGANELLE (Mitochondrion) BIOLOGICAL MOLECULE (Phospholipid) ATOM (Oxygen) cell from the Latin, cella meaning “small room,” or “hut” Word Roots and Origins www.scilinks.org Topic: Characteristics of Life Keyword: HM60257 mb06se_bios01.qxd 5/18/07 10:37 AM Page 7 8 CHAPTER 1 Homeostasis All living things, from single cells to entire organisms, have mecha- nisms that allow them to maintain stable internal conditions. Without these mechanisms, organisms can die. For example, a cell’s water content is closely controlled by the taking in or releas- ing of water. A cell that takes in too much water will rupture and die. A cell that doesn’t get enough water will also shrivel and die. Homeostasis (HOH-mee-OH-STAY-sis) is the maintenance of a stable level of internal conditions even though environmental conditions are constantly changing. Organisms have regulatory systems that maintain internal conditions, such as temperature, water content, and uptake of nutrients by the cell. In fact, multi- cellular organisms usually have more than one way of maintain- ing important aspects of their internal environment. For example, an owl’s temperature is maintained at about 40°C (104°F). To keep a constant temperature, an owl’s cells burn fuel to produce body heat. In addition, an owl’s feathers can fluff up in cold weather. In this way, they trap an insulating layer of air next to the bird’s body to maintain its body temperature. Metabolism Living organisms use energy to power all the life processes, such as repair, movement, and growth. This energy use depends on metabolism (muh-TAB-uh-LIZ-uhm). Metabolism is the sum of all the chemical reactions that take in and transform energy and materials from the environment. For example, plants, algae, and some bacteria use the sun’s energy to generate sugar molecules during a process called photosynthesis. Some organisms depend on obtaining food energy from other organisms. For instance, an owl’s metabolism allows the owl to extract and modify the chemi- cals trapped in its nightly prey and use them as energy to fuel activities and growth. Growth and Development All living things grow and increase in size. Some nonliving things, such as crystals or icicles, grow by accumulating more of the same material of which they are made. In contrast, the growth of living things results from the division and enlargement of cells. Cell division is the formation of two new cells from an existing cell, as shown in Figure 1-3. In unicellular organisms, the primary change that occurs following cell division is cell enlargement. In multi- cellular life, however, organisms mature through cell division, cell enlargement, and development. Development is the process by which an organism becomes a mature adult. Development involves cell division and cell differen- tiation, or specialization. As a result of development, an adult organism is composed of many cells specialized for different func- tions, such as carrying oxygen in the blood or hearing. In fact, the human body is composed of trillions of specialized cells, all of which originated from a single cell, the fertilized egg. This unicellular organism, Escherichia coli, inhabits the human intestines. E. coli reproduces by means of cell division, during which the original cell splits into two identical offspring cells. FIGURE 1-3 Observing Homeostasis Materials 500 mL beakers (3), wax pen, tap water, thermometer, ice, hot water, goldfish, small dip net, watch or clock with a second hand Procedure 1. Use a wax pen to label three 500 mL beakers as follows: 27°C (80°F), 20°C (68°F), 10°C (50°F). Put 250 mL of tap water in each beaker. Use hot water or ice to adjust the tem- perature of the water in each beaker to match the temperature on the label. 2. Put the goldfish in the beaker of 27°C water. Record the number of times the gills move in 1 minute. 3. Move the goldfish to the beaker of 20°C water. Repeat observations. Move the goldfish to the beaker of 10°C. Repeat observations. Analysis What happens to the rate at which gills move when the temp- erature changes? Why? How do gills help fish maintain homeostasis? Quick Lab mb06se_bios01.qxd 5/18/07 10:37 AM Page 8 THE SCIENCE OF LIFE 9 Reproduction All organisms produce new organisms like themselves in a process called reproduction. Reproduction, unlike other characteristics, is not essential to the survival of an individual organism. However, because no organism lives forever, reproduction is essential for the continuation of a species. Glass frogs, as shown in Figure 1-4, lay many eggs in their lifetime. However, only a few of the frogs’ off- spring reach adulthood and successfully reproduce. During reproduction, organisms transmit hereditary informa- tion to their offspring. Hereditary information is encoded in a large molecule called deoxyribonucleic acid, or DNA. A short segment of DNA that contains the instructions for a single trait of an organism is called a gene. DNA is like a large library. It contains all the books—genes—that the cell will ever need for making all the struc- tures and chemicals necessary for life. Hereditary information is transferred to offspring during two kinds of reproduction. In sexual reproduction, hereditary information recombines from two organisms of the same species. The resulting offspring are similar but not identical to their parents. For example, a male frog’s sperm can fertilize a female’s egg and form a single fer- tilized egg cell. The fertilized egg then develops into a new frog. In asexual reproduction, hereditary information from different organisms is not combined; thus the original organism and the new organism are genetically the same. A bacterium, for example, reproduces asexually when it splits into two identical cells. Change Through Time Although individual organisms experience many changes during their lifetime, their basic genetic characteristics do not change. However, populations of living organisms evolve or change through time. The ability of populations of organisms to change over time is important for survival in a changing world. This factor is also impor- tant in explaining the diversity of life-forms we see on Earth today. 1. How does biology affect a person’s daily life? 2. How does biology affect society? 3. Name the characteristics shared by living things. 4. Summarize the hierarchy of organization found in complex multicellular organisms. 5. What are the different functions of homeostasis and metabolism in living organisms? 6. How does the growth among living and nonliv- ing things differ? 7. Why is reproduction an important characteristic of life? CRITICAL THINKING 8. Applying Information Crystals of salt grow and are highly organized. Why don’t biologists con- sider them to be alive? 9. Analyzing Models When a scientist designs a space probe to detect life on a distant planet, what kinds of things should it measure? 10. Making Comparisons Both cells and organisms share the characteristics of life. How are cells and organismsood supply will be like in the near future.EVOLUTION OF LIFE Individual organisms change during their lifetime, but their basic genetic characteristics do not change. However, populations of liv- ing organisms do change through time, or evolve. Evolution, or descent with modification, is the process in which the inherited characteristics within populations change over generations, such that genetically distinct populations and new species can develop. Evolution as a theme in biology helps us understand how the various branches of the “tree of life” came into existence and have changed over time. It also explains how organisms alive today are related to those that lived in the past. Finally, it helps us understand the mechanisms that underlie the way organisms look and behave. Natural Selection The ability of populations of organisms to change over time is important for survival in a changing world. According to the theory of evolution by natural selection, organisms that have certain favorable traits are better able to survive and reproduce success- fully than organisms that lack these traits. One product of natural selection is the adaptation of organisms to their environment. Adaptations are traits that improve an indi- vidual’s ability to survive and reproduce. For example, rabbits with white fur and short ears in a snowy place, such as the one in Figure 1-7a, may avoid predators and frostbitten ears more often than those with dark fur and long ears. Thus, the next generation of rabbits will have a greater percentage of animals carrying the genes for white fur and short ears. In contrast, the brown, long- eared rabbit, as shown in Figure 1-7b, would survive and reproduce more successfully in a hot desert environment. The survival and reproductive success of organisms with favor- able traits cause a change in populations of organisms over gener- ations. This descent with modification is an important factor in explaining the diversity of organisms we see on Earth today. 1. Name three unifying themes found in biology. 2. How is the unity and diversity in the living world represented? 3. Identify the three domains and the kingdoms found in each domain. 4. How are organisms interdependent? 5. Describe why evolution is important in explain- ing the diversity of life. 6. Distinguish between evolution and natural selection. CRITICAL THINKING 7. Applying Information Assign the various top- pings you put on pizza to the appropriate domains and kingdoms of life. 8. Analyzing Graphics According to the “tree” in Figure 1-5, which of these pairs are more closely related: Archaea:Bacteria or Archaea:Eukarya? 9. Making Hypotheses Fossil evidence shows that bats descended from shrewlike organisms that could not fly. Write a hypothesis for how natural selection might have led to flying bats. SECTION 2 REVIEW (a) This short-eared arctic hare, Lepus arcticus, is hidden from predators and protected from frostbite in a snowy environment. (b) The mottled brown coats of desert rabbits blend in with the dirt and dry grasses, and their long ears help them radiate excess heat and thus avoid overheating. FIGURE 1-7 (a) (b) Copyright © by Holt, Rinehart and Winston. All rights reserved. THE SCIENCE OF LIFE 13 TH E STUDY OF BIOLOGY Curiosity leads us to ask questions about life. Science provides a way of answering such questions about the natural world. Science is a systematic method that involves forming and testing hypotheses. More importantly, science relies on evidence, not beliefs, for drawing conclusions. SCIENCE AS A PROCESS Science is characterized by an organized approach, called the scientific method, to learn how the natural world works. The methods of science are based on two important principles. The first principle is that events in the natural world have natural causes. For example, the ancient Greeks believed that lightning and thunder occurred because a supernatural god Zeus hurled thunderbolts from the heavens. By contrast, a scientist considers lightning and thunder to result from electric charges in the atmos- phere. When trying to solve a puzzle from nature, all scientists, such as the one in Figure 1-8, accept that there is a natural cause to solve that puzzle. A second principle of science is uniformity. Uniformity is the idea that the fundamental laws of nature operate the same way at all places and at all times. For example, scientists assume that the law of gravity works the same way on Mars as it does on Earth. Steps of the Scientific Method Although there is no single method for doing science, scientific studies involve a series of common steps. 1. The process of science begins with an observation. An observation is the act of perceiving a natural occurrence that causes someone to pose a question. 2. One tries to answer the question by forming hypotheses (singular, hypothesis). A hypothesis is a proposed explanation for the way a particular aspect of the natural world functions. 3. A prediction is a statement that forecasts what would happen in a test situation if the hypothesis were true. A prediction is recorded for each hypothesis. 4. An experiment is used to test a hypothesis and its predictions. 5. Once the experiment has been concluded, the data are analyzed and used to draw conclusions. 6. After the data have been analyzed, the data and conclusions are communicated to scientific peers and to the public. This way oth- ers can verify, reject, or modify the researcher’s conclusions. SECTION 3 OBJECTIVES ● Outline the main steps in the scientific method. ● Summarize how observations are used to form hypotheses. ● List the elements of a controlled experiment. ● Describe how scientists use data to draw conclusions. ● Compare a scientific hypothesis and a scientific theory. ● State how communication in science helps prevent dishonesty and bias. VOCABULARY scientific method observation hypothesis prediction experiment control group experimental group independent variable dependent variable theory peer review All researchers, such as the one releasing an owl above, use the scientific method to answer the questions they have about nature. FIGURE 1-8 Copyright © by Holt, Rinehart and Winston. All rights reserved. 14 CHAPTER 1 OBSERVING AND ASKING QUESTIONS The scientific method generally begins with an unexplained observa- tion about nature. For example, people have noticed for thousands of years that owls can catch prey in near total darkness. As shown in steps and of Figure 1-9, an observation may then raise ques- tions. The owl observation raises the question: How does an owl detect prey in the dark? FORMING A HYPOTHESIS After stating a question, a biologist lists possible answers to a sci- entific question—hypotheses. Good hypotheses answer a question and are testable in the natural world. For example, as shown in step Figure 1-9, there are several possible hypotheses for the question of how owls hunt at night: (a) owls hunt by keen vision in the dark; (b) owls hunt by superb hearing; or (c) owls hunt by detecting the prey’s body heat. Predicting To test a hypothesis, scientists make a prediction that logically fol- lows from the hypothesis. A prediction is what is expected to hap- pen if each hypothesis were true. For example, if hypothesis (a) is true, (owls hunt by keen night vision) then one can predict that the owl will pounce only on the mouse in either a light or a dark room. If hypothesis (b) is true (owls hunt by hearing), then one can pre- dict that in a lighted room, the owl will pounce closer to the mouse’s head. But, in a dark room, the owl should pounce closer to a rustling leaf attached to the mouse. Finally, if hypothesis (c) is true (owls hunt by sensing body heat), then an owl would strike only the prey no matter the room conditions, because owls hunt by detecting the prey’s body heat. 3 1 2 Copyright © by Holt, Rinehart and Winston. All rights reserved. A scientific study includes observations, questions, hypotheses, predictions, experiments, data analysis, and conclu- sions. A biologist can use the scientific method to set up an experiment to learn how an owl captures prey at night. FIGURE 1-9 1 OBSERVATION Owls capture prey on dark nights. 2 QUESTION How do owls detect prey on dark nights? 3 HYPOTHESES a) Owls hunt in the dark by vision. b) Owls hunt in the dark by hearing. c) Owls hunt in the dark by sensing body heat. THE SCIENCE OF LIFE 15 Notice that these predictions make it difficult to distinguish be- tween the vision and body heat hypotheses. The reason is that both hypotheses predict that the owl could grab the mouse in a dark room. Also, these three hypotheses do not eliminate all other factors that could influence how the owl finds its prey. However, testing predictions can allow one to begin rejecting hypotheses and thus to get closer to determining the answer(s) to a question. DESIGNING AN EXPERIMENT Biologists often test hypotheses by setting up an experiment. Step in Figure 1-9 outlines an experiment to test the hypotheses about how an owl hunts at night. First, experimenters set up a room with an owl perch high on one side and a small trap door on the other side for releasing mice. Then, they tied a leaf to each mouse’s tail with a string and released each mouse into the room. Next, each mouse ran silently across the room, but the leaf trailed behind, making a rustling noise. During half of the trials, the lights were on. During the other half, the room was dark. Technicians videotaped all the action in the chamber with an infrared light, which owls cannot see. The researchers then viewed the videos and measured the position of the owl’s strike relative to each mouse’s head. Performing the Experiment Many scientists use a controlled experiment to test their hypotheses. A controlled experiment compares an experimental group and a control group and only has one variable. The control group pro- vides a normal standard against which the biologist can compare results of the experimental group. The experimental group is iden- tical to the control group except for one factor, the independent variable. The experimenter manipulates the independent variable, sometimes called the manipulated variable. 4 4 EXPERIMENT 5 DATA COLLECTION AND ANALYSIS Measure and compare the distance from the owl’s strike to the mouse and to the leaf in light and dark. 6 CONCLUSION Data supported the hearing hypothesis: Owls hunt in the dark by hearing. prey Test predictions of the three hypotheses. Control: In the light Experimental: In the dark 1 2 3 4 5 6 7 8 9 10 11 Predicting Results Materials 2 Petri dishes with agar, cellophane tape, wax pen Procedure 1. Open one of the Petri dishes, and streak your finger across the surface of the agar. 2. Replace the lid, and seal it with the tape. Label this Petri dish with your name and a number 1. 3. Seal the second Petri dish with- out removing the lid. Label this Petri dish with your name and the number 2. 4. Write a prediction about what will happen in each dish. Store your dishes as your teacher directs. Record your observations. Follow your teacher’s directions for disposal of your dishes. Analysis Was your prediction accurate? What evidence can you cite to support your prediction? If you did not obtain the results you predicted, would you change your testing method or your prediction? Explain. Evaluate the importance of obtaining a result that does not support your prediction. Quick Lab mb06se_bios03.qxd 5/18/07 10:40 AM Page 15 16 CHAPTER 1 The independent variable in the owl experiment is the presence or absence of light. In the owl experiment, the control group hunts in the light, and the experimental group hunts in the dark. In addi- tion to varying the independent variable, a scientist observes or measures another factor called the dependent variable, or respond- ing variable, because it is affected by the independent variable. In the owl experiment, the dependent variable is distance from the owl’s strike to the mouse’s head. Testing the Experiment Some controlled experiments are conducted “blind.” In other words, the biologist who scores the results is unaware of whether a given subject is part of the experimental or control group. This factor helps eliminate experimenter bias. Experiments should also be repeated, because living systems are variable. Moreover, scien- tists must collect enough data to find meaningful results. COLLECTING AND ANALYZING DATA Most experiments measure a variable—the dependent variable. This measurement provides quantitative data, data measured in numbers. For example, in the experiment above, scientists mea- sured the distance of an owl’s strike from the prey’s head in cen- timeters, as shown in step of Figure 1-9. An event’s duration in milliseconds is also an example of quantitative data. Biologists usually score the results of an experiment by using one of their senses. They might see or hear the results of an experiment. Scientists also extend their senses with a micro- scope for tiny objects or a microphone for soft sounds. In the owl experiment, biologists extended their vision with infrared cameras. Analyzing and Comparing Data After collecting data from a field study or an experiment and then organizing it, biologists then analyze the data. In analyzing data, the goal is to determine whether the data are reliable, and whether they support or fail to support the predictions of the hypothesis. To do so, scientists may use statistics to help determine relation- ships between the variables involved. They can then compare their data with other data that were obtained in other similar studies. It is also important at this time to determine possible sources of error in the experiment just per- formed. Scientists usually display their data in tables or graphs when analyzing it. For the owl study, biologists could have made a bar graph such as the one in Figure 1-10, which shows the average distance from the owl’s strike relative to the mouse’s head or the leaf in the light and in the dark. 5 5 0 10 15 20 25 In the light In the dark Average distance from strike (cm) Distance Between Owl Strike and a Mouse or From a Leaf Attached to Mouse 30 Mouse Leaf Mouse Leaf The data below are hypothetical results that might occur from the described owl experiment.The independent variable is the darkness of the room, and the dependent variable is how far the owl struck from the mouse’s head.The data show that the owl strikes more accurately at the mouse in the light but strikes more accurately at the leaf in the dark. FIGURE 1-10 Copyright © by Holt, Rinehart and Winston. All rights reserved. THE SCIENCE OF LIFE 17 DRAWING CONCLUSIONS Biologists analyze their tables, graphs, and charts to draw conclu- sions about whether or not a hypothesis is supported, as shown in step of Figure 1-9. The hypothetical owl data show that in the light, owls struck with greater accuracy at the mouse than at the leaf, but in the dark, owls struck with greater accuracy at the leaf than the mouse. Thus, the findings support the hearing hypothe- sis, but not the vision hypothesis. An experiment can only disprove, not prove, a hypothesis. For example, one cannot conclude from the results that the hearing hypothesis is proven to be true. Perhaps the owl uses an unknown smell to strike at the mouse. One can only reject the vision hypothe- sis because it did not predict the results of the experiment correctly. Acceptance of a hypothesis is always tentative in science. The scientific community revises its understanding of phenomena, based on new data. Having ruled out one hypothesis, a biologist will devise more tests to try to rule out any remaining hypotheses. Making Inferences Scientists often draw inferences from data gathered during a field study or experiment. An inference (IN-fuhr-uhns) is a conclusion made on the basis of facts and previous knowledge rather than on direct observations. Unlike a hypothesis, an inference is not directly testable. In the owl study, it is inferred that the owl detects prey from a distance rather than by direct touch. Applying Results and Building Models As shown in Figure 1-11, scientists often apply their findings to solve practical problems. They also build models to represent or describe things. For example in 1953, James Watson and Francis Crick used cardboard balls and wire bars to build physical models of atoms in an attempt to understand the structure of DNA. Mathematical models are sets of equations that describe how dif- ferent measurable items interact in a system. The experimenter can adjust variables to better model the real-world data. CONSTRUCTING A THEORY When a set of related hypotheses is confirmed to be true many times, and it can explain a great amount of data, scientists often reclassify it as a theory. Some examples include the quantum the- ory, the cell theory, or the theory of evolution. People commonly use the word “theory” in a different way than scientists use the word. People may say “It’s just a theory” suggesting that an idea is untested, but scientists view a theory as a highly tested, generally accepted principle that explains a vast number of observations and experimental data. 6 Copyright © by Holt, Rinehart and Winston. All rights reserved. Biologists often apply their knowledge of the natural world to practical problems. Studies on the owl’s keen ability to locate sounds in space despite background noise are helping biotechnologists and bioengineers develop better solutions for people with impaired hearing, such as the people shown in this picture. FIGURE 1-11 18 CHAPTER 1 COMMUNICATING IDEAS An essential aspect of scientific research is scientists working together. Scientists often work together in research teams or sim- ply share research results with other scientists. This is done by publishing findings in scientific journals or presenting them at sci- entific meetings, as shown in Figure 1-12. Sharing information allows others working independently to verify findings or to con- tinue work on established results. For example, Roger Payne pub- lished the results of his owl experiments in a journal in 1971. Then, other biologists could repeat it for verification or use it to study the mechanisms introduced by the paper. With the growing impor- tance of science in solving societal issues, it is becoming increas- ingly vital for scientists to be able to communicate with the public at large. Publishing a Paper Scientists submit research papers to scientific journals for publica- tion. A typical research paper has four sections. First, the Introduction poses the problem and hypotheses to be investigated. Next, the Materials and Methods describe how researchers proceeded with the experiment. Third, the Results state the findings the experiment presented, and finally, the Discussion gives the significance of the experiment and future directions the scientists will take. Job Description Forensic biolo- gists are scientists who study biological materials to investigate potential crimes and other legal issues against humans and animals. Forensic scientists have knowledge in areas of biology, such as DNA and blood pattern analysis, and work in private sector and public laboratories. Focus On a Forensic Biologist As a law enforcement forensic specialist for the Texas Parks and Wildlife Department, Beverly Villarreal assists the game warden in investigations of fish and wildlife violations, such as illegal hunting and fishing. Villarreal analyzes blood and tissue samples to identify species of animals such as fish, birds, and reptiles. Her work helps game wardens as they enforce state laws regarding hunting and fishing. Most people think of forensic scientists as the glamorous crime investigators on TV, but according to Villarreal real forensic scientists “spend a great deal of time at a lab bench running analysis after analysis.” Many of the methods used in animal forensics, such as DNA sequenc- ing, are also used in human forensics. Education and Skills • High school—three years of science courses and four years of math courses. • College—bachelor of science in biol- ogy, including course work in zoology and genetics, plus experience in per- forming DNA analyses. • Skills—patience, attention to detail, and ability to use fine tools. Careers in BIOLOGY Forensic Biologist For more about careers, visit go.hrw.com and type in the keyword HM6 Careers. www.scilinks.org Topic: Scientific Investigations Keyword: HM61358 mb06se_bios03.qxd 5/18/07 10:40 AM Page 18 THE SCIENCE OF LIFE 19 1. What two principles make the scientific method a unique process? 2. Define the roles of observations and hypotheses in science. 3. Summarize the parts of a controlled experiment. 4. Summarize how we make conclusions about the results of an experiment. 5. Why is the phrase, “it’s just a theory” misleading? 6. Give another example of a conflict of interest. CRITICAL THINKING 7. Making Hypotheses On a nocturnal owl’s skull, one ear points up, and the other ear points down. Suggest a hypothesis for this observation. 8. Designing Experiments Design an experiment to establish if owls hunt by keen sight or hunt by heat seeking. 9. Calculating Information What was the average distance between the owl’s strike and the mouse if the recorded differences in this experiment were 25, 22, 19, 19, and 15? SECTION 3 REVIEW After scientists submit their papers to a scientific journal, the editors of that journal will send the paper out for peer review. In a peer review, scientists who are experts in the field anonymously read and critique that research paper. They determine if a paper pro- vides enough information so that the experiment can be duplicated and if the author used good experimental controls and reached an accurate conclusion. They also check if the paper is written clearly enough for broad understanding. Careful analysis of each other’s research by fellow scientists is essential to making scientific progress and preventing scientific dishonesty. HONESTY AND BIAS The scientific community depends on both honesty and good sci- ence. While designing new studies, experimenters must be very careful to prevent previous ideas and biases from tainting both the experimental process and the conclusions. Scientists have to keep in mind that they are always trying to disprove their favorite ideas. Scientists repeat experiments to verify previous findings. This allows for science to have a method for self-correction and it also keeps researchers honest and credible to their peers in the field. Conflict of Interest For most scientists, maintaining a good reputation for collecting and presenting valid data is more important than temporary prestige or income. So, scientists try to avoid any potential conflicts of interest. For example, a scientist who owns a biotechnology company and manufactures a drug would not be the best researcher to critically test that drug’s safety and effectiveness. To avoid this potential con- flict of interest, the scientist allows an unaffected party, such as a research group, to test the drug’s effectiveness. The threat of a potential scandal based on misleading data or conclusions is a pow- erful force in science that helps keep scientists honest and fair. Scientists present their experiments in various forms. The scientists above are presenting their work in the form of a poster at a scientific meeting. FIGURE 1-12 Copyright © by Holt, Rinehart and Winston. All rights reserved. The Internet can provide a wealth of scientific information for a report, but the information may not always be credible or accurate. You can use the methods above to check the accuracy and credibility of your sources. SCIENCE TECHNOLOGY SOCIETY SCIENCE ON THE INTERNET: A New Information Age I n the past, students research- ing a science topic would typ- ically begin their research by visiting a library to use printed reference materials, such as encyclopedias. Today, most stu- dents research topics by using a computer and searching for information on the Internet. The Internet can provide students with a wealth of infor- mation. But which Web sites have accurate information, and which Web sites do not? Checking Web Addresses Students should use the Web address, or URL, to establish the Web site’s credibility. Usually, the domain name can suggest who has published the Web site. Web sites can be pub- lished by governmental agen- cies (ends in “dot gov” or .gov), by educational institutions (ends in “dot edu” or .edu), by organizations (ends in “dot org” or .org), or by commercial businesses (ends in “dot com” or .com). Government Web sites are usually reliable. Examples of credible governmental Web sites are the National Institutes of Health (NIH) and the Food and Drug Administration (FDA). University and medical school sites are also reliable sources of information. Many organiza- tions that research and teach the public about specific diseases and conditions can also provide reliable information. Examples of such organizations are the American Cancer Society and the American Heart Association. Evaluating Web Sites The credibility of the author of the Web site should also be checked. Make sure the author is not trying to sell anything and is established in his or her field. For example, a health Web site’s author should be a med- ical professional. It is also important to check the date that the information was posted on the Web to ensure that the information is current. Also, the Web site should provide ref- erences from valid sources, such as scientific journals or govern- ment publications. Finally, the student should always double-check informa- tion between several reliable Web sites. If two or three reliable sites provide the same informa- tion, the student can feel confi- dent in using that information. Web Sites for Students The Internet Connect boxes in this textbook have all been reviewed by professionals at the National Science Teachers Association (NSTA). Students can trust that these sites are reliable sources for science- or health-related topics. REVIEW 1. Which types of Web addresses are the most reliable? 2. List four important features to evaluate when using a Web site for research. 3. Supporting Reasoned Opinions Why do you think a Web site that is advertising a product may not offer accurate information? REVIEW 20 www.scilinks.org Topic: Using the Internet Keyword: HM61589 mb06se_biosts.qxd 5/18/07 10:42 AM Page 20 TOOLS AND TECHNIQUES With proper equipment and good methods, biologists can see, manipulate, and understand the natural world in new ways. Microscopes are one of many useful tools used to unlock nature’s biological secrets. MICROSCOPES AS TOOLS Tools are objects used to improve the performance of a task. Microscopes are tools that extend human vision by making enlarged images of objects. Biologists use microscopes to study organisms, cells, cell parts, and molecules. Microscopes reveal details that otherwise might be difficult or impossible to see. Light Microscopes To see small organisms and cells, biologists typically use a light microscope, such as the one shown in Figure 1-13. A compound light microscope is a microscope that shines light through a spec- imen and has two lenses to magnify an image. To use this micro- scope, one first mounts the specimen to be viewed on a glass slide. The specimen must be thin enough for light to pass through it. For tiny pond organisms, such as the single-celled paramecium, light passing through the organism is not a problem. For thick objects, such as plant stems, biologists must cut thin slices for viewing. There are four major parts of a compound light microscope. For further description of the parts of a micro- scope, see the Appendix. 1. Eyepiece The eyepiece (ocular (AHK-yoo-luhr) lens) magnifies the image, usually 10 times. 2. Objective Lens Light passes through the specimen and then through the objective lens, which is located directly above the specimen. The objective lens enlarges the image of the specimen. Scientists sometimes use stains to make the image easier to see. 3. Stage The stage is a platform that supports a slide holding the specimen. The slide is placed over the opening in the stage of the microscope. 4. Light Source The light source is a light bulb that provides light for viewing the image. It can be either light reflected with a mirror or an incandescent light from a small lamp. SECTION 4 OBJECTIVES ● List the function of each of the major parts of a compound light microscope. ● Compare two kinds of electron microscopes. ● Describe the importance of having the SI system of measurement. ● State some examples of good laboratory practice. VOCABULARY compound light microscope eyepiece (ocular lens) objective lens stage light source magnification nosepiece resolution scanning electron microscope transmission electron microscope metric system base unit Compound light microscopes open the human eye to an interesting world including tiny pond organisms, healthy and diseased cells, and the functioning of cell parts. FIGURE 1-13 Objective lens Eyepiece (ocular lens) Stage Light THE SCIENCE OF LIFE 21 Copyright © by Holt, Rinehart and Winston. All rights reserved. 22 CHAPTER 1 Magnification and Resolution Microscopes vary in powers of magnification and resolution. Magnification is the increase of an object’s apparent size. Revolving the nosepiece, the structure that holds the set of objective lens, rotates these lenses into place above the specimen. In a typical com- pound light microscope, the most powerful objective lens produces an image up to 100 times (100) the specimen’s actual size. The degree of enlargement is called the power of magnification of the lens. The standard ocular lens magnifies a specimen 10 times (10). To compute the power of magnification of a microscope, the power of magnification of the strongest objective lens (in this case, 100) is multiplied by the power of magnification of the ocular lens (10). The result is a total power of magnification of 1000. Resolution (REZ-uh-LOO-shuhn) is the power to show details clearly in an image. The physical properties of light limit the ability of light microscopes to resolve images, as shown in Figure 1-14a. At pow- ers of magnification beyond about 2,000, the image of the speci- men becomes fuzzy. For this reason, scientists use other microscopes to view very small cellsWhat is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 We found you were making a quiz on the subject of "What is a rubric? A tool comprising a set of criteria (with possible levels of performance quality on the criteria) developed to assess learners’ work, from written to oral to visual. It is used tomeasureperformance,suchastheprocess of doing something (e.g.,playing a musical instrument, making a speech) or products of the learners’ work (e.g., concept map, laboratory report, bookshelf) (Brookhart, 2013). BENEFITS OF USING RUBRICS Support authentic assessment Reflects how well learners are able to apply knowledge inthe real-world context. Communicate expectations Gives learners an idea of what is expected of them. It is especially useful when the rubrics are communicated to the learners before they are assessed. Improve performance Explicit criteria and performance level descriptions allow learners to understand the desired performance. Learners are able to assess themselves by referring to the specific criteria and performance-level descriptions. Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Promote thinking andlearning 4 Provide informative feedback Instructors are able to provide constructive feedback to learners on their weaknesses and strengths. Learners are able to review and revise their work,thus reflecting on their learning experiences. Ensure fairness Learner performance assessed fairly given its objectivity. It helps avoid disputes between learners and instructors about the scores/grades achieved. TYPES OF RUBRIC ANALYTIC It consists of individual criterion with corresponding descriptor of performance. HOLISTIC It consists of performance descriptors that are placed together to refeclet to overalll performance. ANATOMY OF ANANALYTIC RUBRIC Rating scales with corresponding scores or weights The row represents the criteria for the desired performance, while the column represents the evaluation score. Under the rating scale (corresponding weights orscorescanbeassigned),theperformance descriptors are explicitly stated ANATOMYOF AHOLISTICRUBRIC Descriptions: It comprises the rating scale (corresponding weights or scores can be assigned) in the row while the combined desired performance descriptors are placed in the column. Description of the task The purpose of the assignment is to assess learner’s cognitive and analytic skills in applying knowledge gained and constructed throughout the course Diffusion of Innovation,bywatching the Surrogates movieand writing ananalytical review of the movie in the context of innovation diffusion.Iwant to provide learners with informative feedback on their cognitive and analytic skills such as the following: applying the concepts of innovation diffusion,making judgmentson the scenes related to innovation diffusion identified from the movie,selecting and critiquing theories of innovation diffusion and making connections between the theories,aswell asarguingand proposing necessary solutions to the problemss hown in the movie. ESTABLISHING ALTERNATIVEASSESSMENTINHIGHEREDUCATION VALIDITYAND RELIABILITYOF RUBRICS. Validity Measuring what is supossedto be measured. Reability Yielding consists results. Instruments that are used in the alternative assessment must be aligned to the learning outcomes and measure well what it intends to measure (valid) and produce consistent scores (reliable). The valid instrument will manifest the true ability (latent trait) of learners and permit appropriate inferences to be made about a specific group of people for specific purposes. TYPES OF VALIDITY FACE VALIDITY Simple form of validity thatapplies a superficial and subjective assessment whether the instrument measures what it is supposed to measure. CONTENT VALIDITY Refers to the extent to which the items on a measure assess the same content or how wellthe content material was sampled inthe measure. CONSTRUCT VALIDITY Refers to the extent to which the test may be said to measure a theoretical construct or trait. CONCURRENT VALIDITY Refers to the extent to which scores onanewmeasure are related to scores from a criterion measure administered at the same time. PREDICTIVE VALIDITY Refers to the uses of the scores from the new measure to predict performance on a criterion measure administered ata later time. STEPS TO CONSIDER WHEN ESTABLISHING CONTENT VALIDITY Calculate the level of expert agreeement for the content validity, get expert to verfy. Interview the expert ,make meta contentdata análisis from literatura. STEPS TO CONSIDER WHEN ESTABLISHING CONSTRUCCT VALIDITY Administer the instrument for alll learners, revise any item necccesay, run an apropriates statistical analiysis, administerthe instrument to learners as a pilot test . CONSTRUCTMAP Morepreciseconceptthan construct. Ranges from one extreme to another(fromhightolow,small tolarge,positivetonegative,or strongtoweak). Identifiesthepositionofthe respondentsinthisrange. Representativenessofsampling (questions and ability of respondents). EXAMPLEO FACONSTRUCTMAP:AFFECTIVE LEVELOF AFFECTIVE VARIABLES EXAMPLESOFITEMSIN MEASURINGTEAM WORKING SKILLS 5. Characterisation Learnersvolunteerstodothe groupworks. 4. Organisation Learners are willing to help others,althoughitisnottheir scopeoftask. 3. Valuing Learners respect other team members’opinionwhendoing thediscussion. 2. Responding Learnergivescooperationwhen neededingroupworks. 1. Receiving Learneracceptsthediversityof races and nationalities among groupmembers. EXAMPLEOFACONSTRUCTMAP:PSYCHOMOTOR LEVELOF PSYCHOMOTOR VARIABLES EXAMPLESOFITEMSIN MEASURING DIGITAL SKILLS 7.Origination Learnerscanmodifytheirowndevicesto performbetter. 6.Adaptation Learnerscansolveandtroubleshootthe problemwhileusingthecomputer. 5.ComplexOvertResponse Learnerscanusethecomputercompetently. 4.Mechanism Learners can use the computer independently,butstillmakeminorerrors. 3.GuidedResponses Learnerscanusethecomputer,butstill needguidance. 2.Set Learnersarereadytousethecomputer. 1.Perception Learnerscanobservehowtousecomputer. EXAMPLEOFACONSTRUCTMAP:COGNITIVE LEVELOF COGNITIV E VARIABLES EXAMPLESOFITEMS IN MEASURING THINKINGSKILLS 6. Creating Learners are able to suggest anewmodelorframeworkof learningdigitalcommunity. 5. Evaluating Learners are able to judge the impactofthescenariotowards educationperspective. 4. Analysing Learnerscandifferentiate the factsusingafew theories. 3. Applying Learnerscansolveproblems usingthefactsgiven. 2. Understanding Learnersareabletoexplainthe factsusingtheirownwords. 1. Remembering Learnersonlymemorisethe. Direction of Increasing “X” Learners Learners with high “X” Learners with mid range “X” Learners with low “X” Responses to Item Item response indicate highest level of X Item response indicate higher level of X Item response indicate lower level of X The construct map shows the lower ability students are in line with the lower level of items. This shows that when educators plan to develop an instrument, it Item response indicate lowest level of X Direction of Decreasing “X” is crucial to create an item difficulty thatrepresents learners’ ability. Learners’ ability Learners who engage in level characterisation Learners who engage in level organisation Learners who engage in level valuing Learners who engage in level responding Learners who engage in level receiving Direction of Decreasing“X” MEASURINGCONSTRUCTVALIDITY Unlike content validity, this construct validity can be analysed using statistical analysis. Use Exploratory FactorAnalysis [EFA], Confirmatory FactorAnalysis [CFA] or Unidimensionality to confirm all items are measuring the right construct and the raw variance explained for the latent variables is sufficient. Gap initem map also can show accuracy in construct validity. RELIABILITY The degree to which test scores are consistent over repeated administrations of the same/ equivalent test and therefore considered dependable and repeatable for an individual learner.A test thatproduces highly consistent and stable results (i.e. relative free from random error) is said to be highly reliable. TYPESOFRELIABILITY Test-retest demonstrates the stability of a measure over time 01 Internal consistency most of the items within a rating scale of a concept show consistency of scoring. Inter-rater the extent to which two or more independent raters are consistent in observing, recording and scoring data (should be 70% or higher agreement) 04 Intra-rater relies on one rater to rate an object or event twice (70% or higher of agreement) FACTORSAFFECTING VALIDITYANDHOWTO INCREASEVALIDITY? FACTORS AFFECTING VALIDITY HOWTO INCREASE VALIDITY? 1. Inaccuracy of items in measuringtheoutcomes 1. Vetting session to get reviewsfromtheexpert. 2. Pooritemsdevelopment 2. Followtheformatandtips indevelopinggooditems. 3. Unclearinstructions 3. Do pilot testing to measuretheusabilityof thetest. 4. Interveningevents 4. Controltheinternalthreats validityfactors. 5. Itemsdifficultyisnot suitableforthelearners 5. Create a construct map toensurethereisanitem thatrepresentslearners ability. FACTORS AFFECTING RELIABILIT Y HOWTOINCREASERELIABILITY? 1. TestLength 1. Thetestlengthshouldbeappropriate withtestdifficulty. 2. Test retest interval 2. Suggesteddurationisbetween3 weeksto2months. 3. Variability of scores 3. Doconstructmaptoensuretheitems aresuitablewithlearners’ability. 4. Guessing 4. Penalisetheguessinganswers.You alsocandetecteitherthelearnersare guessing or not using the statistical analysis named guessing analysis andpersonfitanalysis. 5. Inconsistency score from different raters 5. Appointtheratertomarkcertain questionsforalllearners(Thisalways happen when you have more than onesectionandhavemorethanone lecturer). CONCLUSION Coming back to the issue of validity and reliability in assessment, there is a need for educators to put an effort to ensurethattheitemsintheformofquestionsorinstructions arenotonlyclearbutalsoabletomeasurewhatitisintended tomeasurebasedontherelatedlearningoutcomes. Establishingvalidityandreliabilityofinstrumentscan provide educators with some indications of the quality of the measuring tools being used. Valid and reliable instruments enabletheeducatorstocontinuouslyusethemeasuringtools withoutreservation. Reliablenot valid Precisenot Accurate Reliableand valid Preciseand Accurate NotReliable butvalid NotPrecisebut Accurate NotReliable butNotvalid NotPrecisebut NotAccurate 94 ". Would you like to continue making it or start afresh?