Which of the following are properties of Spark transformations?

They are not computed right away

They are vulnerable to machine failures

Which of the following is not a property of Spark Actions?

They cause Spark to execute the recipe to transform the source data

They are the primary mechanism for getting results out of Spark

The results are returned to the driver

Which of the following is not true for DataFrame?

DataFrame in Apache Spark is behind RDD

We can build DataFrame from different data sources. structured data file, tables in Hive

Both in Scala and Java, we represent DataFrame as Dataset of rows.

The Application Programming Interface (APIs) of DataFrame is available in various languages

What is action in Spark RDD?

The ways to send result from executors to the driver

Takes RDD as input and produces one or more RDD as output.

Which of the following is not true for map() Operation?

Map allows returning 0, 1 or more elements from map function.

In the Map operation developer can define his own custom business logic.

Map transforms an RDD of length N into another RDD of length N.

It applies to each element of RDD and it returns the result as new RDD

Point out the correct statement.

For cluster manager, Spark supports standalone Hadoop YARN

Hive SQL is a component on top of Spark Core

RSS abstraction provides distributed task dispatching, scheduling, and basic I/O functionalities

BIG DATA ANALYTICS ALL 3 MODULE

Why and How Managers Plan Importance of planning The planing process Benefits of planning Planning and time management Types of PLans used by managers Long term and short term plans Strageic and tactical plans Operational plans Planning Tools and Techiqunes Forecasting Contrigency planning Scenario planning Benchmaking Use of staff planners Implementing Plans to Achive Results Goal setting Goal management Goal alignment Participation and involvement Planning Def: The process of setting objectives and determining how best to accomplish them Planning at Eaton Corporation “Making the hard decision before events force them upon you, an anticipating the future needs of the market before the demand asset itself Objectives and goals Identifity the specific results or desired outcomes that one intends to achieve Plan Def: A statement of action steps to be taken in order to accomplish the objectives (goals) Steps in the planning process: Define your objectives Determine where you stand vis-a-vis objectives Develpo premises reagrdsing future conditions Analyze alternatives and make a plan Implement the plan and evaluate results What are the benefits of planning Improves focus and flexibility Imporves action orteitation Imporves coordination and control Imporves time management Time Managment Personal time management tips Do say “no” to request that distract you form what you should be doing Dont get bogged down inn details that can be addressed later Do screen telephone calls, emails and meeting request Dont let drop in visitors, text messaging use up your time Do prioritize your important and urgent work Dont become calendar bound by letting other control your schedule Do follow priorities; do most important and urgent work first Some 77% of mangers in one survey said that digital age has increased th number of decisions they have to make 43% said there was less time available to make these decisions Types of plans used by Managers What is teh time horizon Long term vs Short term Long term Look three or more years into teh future Short term plans Typically cover one year or less However: the increasing environmental complexity and dynamism of recent years has severely tested the concept of “long-term” planning Plans are subject to frequent revisions Most executives would likely agree that these complexities adn uncertainties challenge how er actually go about planning and how far ahead we can really plan At the very least we can conclude that there is a lot less permanency to long term plans today and that tey are subject to frequent revision Managment reaeracher Eillot Jaques believes tha people vary in their capability to think with different time horizons Types of Plans used by Managers (3 of 5) Strategic plans Set broad, comprehensive and linger term action directions for teh entire organization or major division Vision Clarifies purpose of the organization and what it hopes to be on the future Typical plans Specify how the organizations resources are used to implement strategy Tactical plans in business often take the form of functional plans Functional plans Incidate how different component within the organiztion will help accompnlish the overall strategy Production plans Finacial plans Facilites Plans Logisitc plans Marketing plans Human Resource Plans Operation plans Describe short-term activities to implement strategic plans Policies: Are standing plans that communicate guidelines for decisions Ex: Policies on office romances: The media is quick to report when a top executive or public figures runs into trouble over an office affair. Are there ant policies on office romances? Employer polices on office raltioshiis vary. One survey find teh following: 24% prohibit relationships among employees in the same department 13% prohibit relationships among employees who have the smae supervisor 80% prohibit relationships between supervisors and subordinates 5% have no restrictions on office romances Procedures: Are rules that describe actions to be taken in specific situations Budgets: are single use plans that commit resources to projects or activities Zero based budgets: allocate resources as if each budget were brand new There is no guarantee that any past funding will be renwer. All propsales, old and new, must compete for available funds at teh start of each new budget cycle Forcasting Attempts to predict the future Qualitaive forecasting uses expert opinions Quantitative forecasting uses mathematical models and statiscal aanylsis of historical data dna surveys Contingency planning Identify alternative course of action to take when things go wrong Anticipate changing conditions Contain trigger points to indicate when to activate plan (or a specific course of action) Scenario planning A long term version of contingency planning Identifying alternative future scenarios Plans made for each future scenario Increases organizations flexibility and preparation for future shocks Benchmarking Use of external and internal comparisons to better evaluate current performance Adopting best practices: things people adn organization do that lead to superior performance Staff Planners Experts who assist in all steps of the planning process They help bring focus and expertise to a wide variety of planning tasks Important: Communication between staff planers landline managers is essential for teh success of teh planning process Goal Setting - Always set SMART goal The solution: Goal Aligment Between Team Leader and Team Member Jonintly plan: Set objectives, set standards, choose actions Individually acy: Perform tasks (member), provide support (leader) Jointly control: Review results, discuss implications, renew cycle x4 Collective effort and commitment Participatroy planning Includes in all planning steps that people who will be affected by the plans adn askedd to help implement them Unloacks motivational potential of goal setting Management by objective (MBO) promotes participation Participation increases understanding and acceptance of plan and commitment to success Participatory planning - Number of people involved in teh decision making process Amazon is intensely focused on what it does. It believes in creating tight single-threaded teams, also known as “2 pizza team.” Data and Decision Making What are some of the important competencies managers must have today? Delegate Marketing and technology Manager must have Technological competency Ability to understand new technologies and to use them to their best advantage Information competency Ability to locate, gather, organize and display information for decision-making and problem solving Analytical competency Ability to evaluate and analyze information to make actual decisions and solve real problems What is the difference between Data and Information Data Raw facts and observation Information Data made useful and meaningful for decision-making Important concepts Big data Exists in huge quantities and is difficult to process without sophisticated mathematical and analytical techniques Data production today Bernard Marr is an internationally best-selling author. He helps organizations improve their business performance, use data more intelligently Data mining The process of analyzing data to produce useful information for decision-makers Management Analytics The systematic evaluation and analysis of data to make informed decision Information drives management Bad Data Refers to information that can be erroneous, misleading, and without general formatting The challenge: Can er use the data that is available in the “Big Data” Needs to be valid Can not trust everything out there Being ethical Look at the trends Data is structured and unstructured Data BIg Data = Structured + Unstructured Information Drive Management decision making What are the characteristics of useful information Easy to access If its credible Accurate Characteristics of useful information: Timely High quality Complete Relevant Understandable What about bad data It's not credible Miss information If it is not structured/ organized Bias based on opinions Confusing If its updated Bad data Refers to information that can be erroneous miss What are some examples of Management information system Business intelligence -BI Information systems to extract and report data in organized ways that are useful to decision-makers Executive dashboards Visually update and display key performance metrics (or Key Performance Indicators -KPIs) and information on a real-time basis Information needs in organization External Environment Information exchanges with the external environment Gather intelligence information Provide public information Information needs within the organizations (internal Enviroement) Information exchange within the organization Facilitate decision making Facilitate problem-solving Managers as information processors Continually gather, share and receive information Now as much electronic as it is face-to-face Always on, always connected How many people telecommute at least once a week 70% of people globally work remotely at least once a week, Work at home after covid 19 our forecast Our best estimate it that 25-30% of the workforce will be working form home multiple days a week by the end of 2021 As of 2023, 12.7% of full time employees work from home, while 28.2% work a hybrid model Managers as problem solvers Problem-solving The process of identifying a discrepancy between actual and desired performance and taking action to resolve it Ishikawa Fishbone diagram To identify the cause of problems Decision A choice among possible alternative courses of action Performance threat Something is wrong or has the potential to go wrong Performance opportunity The situation offers the chance for a better future if the right steps are taken Problem-solving approaches or style - from textbook Problem avoiders Inactive in information gathering and solving problems Problem seekers Proactive in anticipation of problems and opportunities and taking appropriate action to gain an advantage Problem solvers Reactive in gathering information and solving problem Managers - can approach problems in a systematic or intuitive manner Systematic thinking approaches problem in rational, step-by-step and analytical fashion Intuitive thinking approaches problems in a flexible and spontaneous fashion Multidimensional thinking- applies both intuitive and systematic thinking Managers face structured and unstructured problems Structure problems Are ones that are familiar, straight forward, and clear with respect to information needs Program decisions apply solutions that are readily available from past experiences to solve structured problems Know how to solve them Familiar Know what we are dealing with Unstructured problems Are ones that are full of ambiguities and information deficiencies Nonprogrammed decisions apply a specific solution to meet the demands of a unique problem Commonly faced by higher-level management Crisis decision making A crisis involves an unexpected problem that can lead to disaster if not resolved quickly and appropriately Ruled for crisis management Figure out what is going on Remember that speed matters Remember that slow counts, too Respect the danger of the unfamiliar Value the skeptic Be ready to “fight fire with fire” Managers make decisions with various amounts of information Certain environment Offers complete information on possible action alternatives and their consequences Risk environment Lacks complete information but offers probabilities of the likely outcomes for possible action alternatives Uncertain environment Lacks so much information that it is difficult to assign probabilities to the likely outcomes of alternative Ex: Certain and uncertain environments: The worldwide Governance Indicators for over 200 countries, comparing distinct environments (Canada-Brazil) Step 1-Identify and define the problem Focuses on information gathering information processing and deliberation Decision objectives should be established What are some common mistakes in definding problems? Common mistakes in defining problems Defining the problem too broadly or too narrowly Focusing on symptoms instead of causes Choosing the wrong problem to deal with Step 2- Generate and Evaluate Alternative Courses of Action Potential solutions are formulated and more information is gathered, data are analyzed, the advantages and disadvantages of alternative solutions are identified Common mistakes: Abandoning the search for alternatives too quickly Step 3- Decide on a preferred course of Action Two different approaches Behavioural model leads to satisficing decisions Classical model les to optimising decisions Behavioural Model Rationality is bounded because: There are limits our thinks capacity Available information (incomplete) Time constraints Step 4-Implement the decision Involves taking action to make sure the solution decided upon becomes a reality Managers need to have the willingness and ability to implement action plans Problems: Lack of participation error should be avoided Step 5 - Evaluate Results Involves comparing actual and desired results The positive and negative consequences of the chosen course of action should be examined If actual results fall short desire results, the manager returns to earlier steps in the decision-making process At all steps, check ethical reasoning Ask these spotlight questions Utility Does teh decision satisfy all constituents or stakeholders Rights Does the description respect the rights and duties of everyone? Justice Is the decision consistent with the canons of justice Caring Is the decision consistent with my responsibilities to care? Issues in decision-making How do errors happen? Heuristics: are strategies for simplifying decision-making Availability Bias: Bases a decision on recent information or events Representativeness bias: Bases a decision on similarity to other situations Anchoring and Adjustment Bias: Bases a decision on incremental adjustment from a prior decision point Framing error: Tring to solve a problem in the context perceived, positive or negative Confirmation Error: Focusing on information that confirms a decision already made Escalating commitment: Continuing a course of action even though it is not working Creative Decision making Creativity is the generation of a novel idea or unique approach that solves a problem or crafts an opportunity Big C: Creativity occurs when extraordinary things are done by exceptional people Little C: Creativity occurs when average people come up with unique ways to deal with daily events and situations The three types of situational creativity drivers Chapter review What are objectives and goals? The specific results or desired outcomes What are the 5 characteristics of great (SMART) goals? Forecasting - Attempts Qualitative forecasting uses options Quantitative forecasting uses mathematical models and statistical analysis of historical data and surveys Scenarios-Oracle’s crystal ball combines qualitative and quantitative methods

Big Data Analytics

FAR661 - Big Data & Analytics

Management and Globalization Global Management Why companies go global How companies for global Global Business environments Global Business Types of global business Pros and cons of global businesses Ethnic Challenges for global business Culture and Global Diversity Cultural intelligence Silent language of culture Tight and loose cultures Values and national cultures Global Management Learning Are management theories universal? Intercultural competencies Global learning goals Key concepts of the challenges of globalisation: Global economy Resources, markets and competition are worldwide in scope Internationalisation The process of increasing involvement in international operations Globalization/Deglobalization Glob- the growing interdependence among elements in the global economy The worldwide interdependence of resource flows, product markets and business competition World 3.0 Different views: World flat vs. round Distance is a metaphor that represents the degree of dissimilarities between countries Balancing cooperation in the global Global Management Global management - managing things in different countries Managing business and organizations with interests in more than one country What do we expect from global Managers Knowing how to adapt Knowing the language Global Manager Is culturally aware and informed on international affairs International Business Conducting for-profit transactions of goods and services across national boundaries International Motive Why do firms internatioalize their activities Cheaper labour Labour tax Natural resources Enrolments to do business Clientele Exclusive materials Personal benefits: Taxes Reasons why businesses go global Customers Suppluers Capital During (1993) - 4 motive 1. Market seeking 2. Efficiency Seeking 3. Resource seeking 4. Strategic Asset Seeking Cuervo Cazurra, Narula and un (2015) - 4 motive s Internationalization Motives A company may also explore the opportunities in different markets in order to take advantage and in some cases extend the product life cycle What is a Market Entry Strategy Involves the sale of goods or services to foreign markets but do not require expensive investments Franchising Exporting and importing Involve the sale of goods or services to foreign markets but do Types of market entry strategies Global sourcing Exporting Importing Licensing agreement Franchising Types of Foreign Direct Investment (FDI) strategies: Joint venture Strategic alliance Owned Subsidiary (sometimes called WOS) How to go abroad What conditions will affect the decisions of firms on how to internationalize their activities? During (1978)- Eclectic paradigm OLI model OLI- Ownership, Location and Internalization Advantages Ownership advantages Resources owned by the organization that can be transferred across locations include trademarks, production techniques and processes, managerial skills and other resources not available to the competitors Location Advantages Represent the implications of choosing to produce or to perform activities in a specific location (country or region) Internalization Advantages: The ability to internalize or to incorporate activities that add value to its business Evolution of Concepts- New Elements Although economic factors are certainly important to explain the formation, growth and expansion of firms within and across national borders, they are not sufficient to explain the additional complexity when a firm decides to expand its activities across national borders Economic factors Investigate the economic elements that affect the internationalization of firms Behavioural Elements Explaining the additional challenges (and perhaps opportunities) a firm faces in foreign host countries when compared to indigenous (local) firms Behavioural theories Johanson and Wiedersheim-Paul (1975) and Johanson and Vahlne (1977) Included the psychic Distance concept (beckerman,1956) to explain the internationalization behaviour of firms The Uppsala internationalization model Psychic distance is: the sum of factors preventing the flow of infomatio from and to the market Psychic Distance is a broad concept that includes several elements such as: language, culture, political systems, level of education, level of industrial development Firms behave in a “Risk Averse” manner It means that when the perceived risk goes down, the firm increase its commitment to the foreign market \ The Haier Group Data Strategy Big DATA and Small DATA The use of small data to satisfy individual customers’ needs, however, the book mentions a huge cultural shock at the plant in Camden, south caroline Ex: top down, hard hat colors and hierarchy Culutral Differnces can have a huge impact on the internationalization of firms Kogut and Singh (1988)- Cultural Distance Index First statsical study on the implication of ciltiral distance to the selection of entry mode When investigating in culturally distant countries, foreign firms can choose to partner with foreign firms in order to gain local knowledge and share the risk associated to the investment (higher commitment = higher risk) How Companies Go Global Global sourcing The process of purchasing materials or services around teh world for local use Exporting Selling locally made products in foreign markets Importing Buying foreign made products and selling them domestically Exports correspond to what percentage of Candain GDP What countries are the major trending partners of Canada Management and Globalization How Companies Go Global Licensing Agreement One firm pays a fee for rights to make or sell another company’s products What are the potential risks associated to licesning The case of new balance in China Franchising A fee is paid for the rights to use another firms name, branding and methods Insourcing Insourcing: refers to local job creation that results from foreign direct investment Types of insourcing Joint ventures: operate in a foreign country through co-ownership by foreign and local partners Strategic alliances: A partnership in which foreign and domestic firms share resources and knowledge for mutual gains Foreign subsidiaries: local operation completely owned by a foreign firm Criteria for choosing a joint venture partner: Familiarity with your firm’s major business String local workforce Values its customers Future expansion possibilities Strong local market for partner’s own products Good Profit potential Sound financial standing Global business environments Legal and poliical systems Trade agreements and trade barriers Regional economic alliances Legal and political systems Differing laws and practices regards Business ownership Negotiation and implementation of contracts Foreign currency exchange Protection of intellectual property rights Counterfeit merchandise Political risk Potential loss in value of foreign investment due to instability and political changes in the host country Political risk analysis (expertise/experience) Forecast political disruptions that threaten the value of a foreign investment Changes in the rules of the game Brexit US Trade Wars-mexico-China Other examples Bolivia, Venezuela, China De-globalization The process of weakening interdependence among nations Trade Agreements and trade Barriers World trade organization Most favourd nation status Tariffs Nontariss barriers (quotes, restrictions, etc.) Protectionism Regional Economic Alliances USMCA (replacment for the NAFTA-North American Free trade Agreement) EU- European Union APEC- Aisa Pacific Economic Copperation ASEAN - Association of Southeast Asian Nationas SADC - Southern Africa Development Community MERCOSUR- Chapter 5- Global Management and Cultural Diversity (part 2) Review Types of global business Global corporation MNE (multinational enterprise) or MNC (multinational corporation) with extensive business operations in more than one foreign country Transnational corporation A global corporation that operates worldwide on borderless basis Some host country complaints about MNCs Host Country companits about MNCs: Excessive profits Interference with local government Domination of local economy Interference with local government Hiring the best local talent Limited technology transfer Disrespect for local customers Examples - War in Ukraine Disruption in global -value chains and increased pressure and interference of MNCs with local government Fertilizer imports in Brazil (one of the major producers of agricultural commodities) We must consider the triple bottom line and the impact in society, the environment and the economy $2.5 billion invest in potash mine in Brazill What about Globalization gap Large multinationals adn industrilizednaitons gaining disporoportinonally form globalization Globalization gap: Large multinational and industrialized nations gaining disproportionally from Globalization Some MNC complaints about host countries MNC Complaints about host countries: Profiit limitations Laws and regulations Overpirce resources Exploitative rules Foreign exchange restriction Failure to uphold contracts Mutual benefits for host countries and multinational companies Mutual benefits for host country and global corporation of MNC: Shared growth opportunities Shared income opportunities Shared learning opportunities Share development opportunities Develop projects together What are some of the ethical challenges for global business Ethincal challenges for global business Child labour Employmnet of children for worl otherwise done by adults Sweatshops Employment of workers at very low wages for long hours in poor working conditions Ex: Nike bad labour prices Unsafe working conditions Corruption Illegal practices that further one’s business interests Corrupiotn of froeign public officials Act makes it illegal for Candain firms and their representatives to engage in corrupt practices overseas Bribes to foreign officials Excessive commissions Non-monetary gifts Sweatshops Conflict materials What is culture Culture : The shared set of beliefs, values, and patterns of behvaiourr common to a group of people Food preferences Values and traditions Language and beliefs Religion Art music Life style Hofstede defines culture as: “The collectiv programing of teh mind distinguishing the members of one group or category of people from others” What is culture shock Culture Shock: Confusion and discoumfert a person experiences in an unfaamiliar culture Stages to adjusting to a new culture Confusion Small vitorires The honeymoon Irritation and anger Reality Cultural Intelligence The ability to adapt and adjust to new cultures What is Ethnocentrism Tendency to consider one’s own culture as superior others Slinet languages of culture Contect Low context High context Space Proxemics Ex: personal space Time Monochronic Polychronic High and low contexts cultures Edward T.Hall (1959) Def: Part of a discourse that surround a word or passage and can throw on its meaning Low context cultures Emphizes communication via spoken or written words Countries like United States, Canada and Germany High context cultures Rely on nonverbal and situational cues as well as on spoken or written works Thailand Malaysia Time Monochronic cultures People tend to do one thing at a time Canda Polychronic cultures Time is used to accomplish many different things at once Egypt Space Proxemics Study of how people use space to communicate In North American people value “personal space’ Many Latin and Asian cultures expect much less personal space Tight and Loose Cultures Cultural tightness-looseness Tight = Strength of norms that govern social behvaviour Japan, Korea, Malaysia Loose = tolerance for any deviation from norms Australia, Brazil, Hungary Values and national cultures (Hofstede) Power distance Uncertainty avoidance Individalism-collectivism Masculinity-femininty Time Orientation Indulgence vs. Restraint Comparative management How management pratices systematically differ among countries and /or cultures Intercultural competencies Skills and personal characteristics that help us be successful in cross cultural situations Global Managers (know how to adapt) Need to successfully apply management functions across interantional boundaries Global Learning goals Not universal Engage critical thinking Look everywhere for new management ideas Always consider culture

Big data

Big Data and its Apps available

Related quizzes

Related quizzes