An Overview of Research and Development in Academia

  • First Online: 03 February 2022

Cite this chapter

Book cover

  • Elias Baydoun 4 ,
  • Joelle Mesmar 4 ,
  • Abdul Rahman Beydoun 5 &
  • John R. Hillman 6  

291 Accesses

This overview chapter encompasses the main underpinning themes of research and development (R&D) of universities around the world. Our observations and opinions apply equally to public-sector university-linked research institutes that conduct mainly original research as opposed to policy research. After an Introduction that includes defining the terms used in the chapter and scoping the topic, the main 13 sections of the chapter cover (a) R&D as a fundamental feature of human development reflecting the inherent curiosity of humans and their ability to learn and implement their knowledge. (b) The rationale for modern governments to invest in R&D, referring to the New Growth Theory and meeting the needs of modern societies. (c) The rationale for private-sector organisations to invest in R&D to ensure their long-term sustainability and competitiveness. (d) The various definitions and concepts of R&D. and Research & Experimental Development. (e) The roles and implications of the rapidly expanding number of transformative technologies that are not only profoundly transforming virtually all R&D but also the operation of modern societies including universities. (f) The need for specialist facilities, staffing, and learned societies for R&D to thrive. (g) The importance of international collaboration. (h) Funding sources for R&D. (i) The actuality of academic R&D, including both good practice and deleterious effects of poor management. (j) The pivotal wide-ranging roles of governments. (k) Impediments to successful R&D in both the public and private sectors. (l) Geopolitical aspects of R&D, and (m) Future of R&D. The Conclusions Section considers recommendations on R&D policies for the Arab world as well as for developing economies based on our global analysis of R&D.

  • Basic research
  • Applied research
  • Scientific research
  • Humanities research
  • Artistic research
  • Development
  • New Growth Theory
  • Concepts of R&D
  • Transformative technologies
  • Research geopolitics
  • Future of R&D

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
  • Available as EPUB and PDF
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
  • Durable hardcover edition

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Organization for Economic Co-operation and Development (2020) Concepts and definitions for identifying R&D. https://www.oecd-ilibrary.org/science-and-technology/frascati-manual-2015/concepts-and-definitions-for-identifying-r-amp-d_9789264239012-4-en

National Science Foundation (2018) Definitions of research and development: an annotated compilation of official sources. https://www.nsf.gov/statistics/randdef/rd-definitions.pdf

BusinessDictionary.com (2020) Research. http://www.businessdictionary.com/definition/research.html

BusinessDictionary.com (2020) Research methodology. http://www.businessdictionary.com/definition/research-methodology.html

Wikipedia (2020) Research and development. https://en.wikipedia.org/wiki/Research_and_development

Holstein WK, McLeod TS (2020) Research and development. Britannica. https://www.britannica.com/topic/research-and-development

Hillman JR, Baydoun E (2018) The future of universities in the Arab Region: a review. In: Badran A et al (eds) Universities in Arab countries: an urgent need for change. Springer, Cham, pp 1–53. https://doi.org/10.1007/978-3-319-73111-7_1

Chapter   Google Scholar  

Hillman JR, Baydoun E (2019) Quality assurance and relevance in academia: a review. In: Badran et al (eds) Major challenges facing higher education in the Arab world: quality assurance and relevance. Springer, Cham, pp 13–68. https://doi.org/10.1007/978-3-030-03774-1_2

Hillman JR, Baydoun E (2020) Innovation, creativity, and entrepreneurship in academia: a review. In: Badran A et al. (eds.) Higher education in the Arab world: building a culture of innovation and entrepreneurship. Springer, Cham, 13–71. https://doi.org/10.1007/978-3-030-37834-9_2

Hillman JR, Baydoun E (2020) Review of the roles of governments and universities and their interrelationships: an urgent need for governance reform in the Arab world. In: Badran et al (eds) Higher education in the Arab world: government and governance. Springer, Cham, pp 1–79. https://doi.org/10.1007/978-3-030-58153-4 . (ISBN: 978-3-030-58152-7)

Hillman JR, Baydoun E (2020) An overview of innovation and entrepreneurship to address climate change. In: Badran A et al (eds) Higher education in the Arab world: building a culture of innovation and entrepreneurship. Springer, Cham, pp 141–181. https://doi.org/10.1007/978-3-030-37834-9_6 . (ISBN: 978-3-030-37834-9)

The World Bank (2020) World development indicators. DataBank. https://databank.worldbank.org/source/world-development-indicators

Tutor2u (2020) Measuring development – key indicators. Study notes. https://www.tutor2u.net/economics/reference/measuring-development-key-indicators

Tutor2u (2020) Key gap indicators of development. Study notes. https://www.tutor2u.net/geography/reference/the-8-key-gap-indicators-of-development

Google Scholar  

University of Cambridge, Research Operations Office (2020) Frascati definition of research. https://www.research-operations.admin.cam.ac.uk/policies/frascati-definition-research

Organization for Economic Co-operation and Development (2020) Frascati Manual 2015. Guidelines for Collecting and Reporting Data on Research and Experimental Development. https://www.oecd.org/publications/frascati-manual-2015-9789264239012-en.htm

Wikipedia (2020) Christopher Freeman. https://en.wikipedia.org/wiki/Christopher_Freeman

Wikipedia (2020) Frascati Manual. https://en.wikipedia.org/wiki/Frascati_Manual

Burnewicz J, Bak M (2017) Classification of scientific research (for discussion) https://www.slideshare.net/JANBUR/2017-02-classification-of-the-scientific-research-by-jan-burnewicz-amp-monika-bak-university-of-gdansk

International Network for Natural Sciences (2020) Types of scientific research. https://innspub.net/types-of-scientific-research/

Schwab K (2015) The fourth industrial revolution. What it means and how to respond. Foreign Affairs. https://www.foreignaffairs.com/articles/2015-12-12/fourth-industrial-revolution

Wikipedia (2020) Fourth industrial revolution. https://en.wikipedia.org/wiki/Fourth_Industrial_Revolution

World Economic Forum (2016) The future of jobs. Employment, skills and workforce strategy for the fourth industrial revolution. http://www3.weforum.org/docs/WEF_Future_of_Jobs.pdf

World Economic Forum (2018) The future of jobs report. https://www.weforum.org/reports/the-future-of-jobs-report-2018

World Economic Forum (2020) Jobs of tomorrow: mapping opportunity in the new economy. https://www.weforum.org/reports/jobs-of-tomorrow-mapping-opportunity-in-the-new-economy

Fadel C (2008) 21st Century Skills: how can you prepare students for the new Global Economy? Partnership for 21st Century Skills. Organization for Economic Co-operation and Development Centre for Research and Innovation. https://www.oecd.org/site/educeri21st/40756908.pdf

Heney P, Studt T (2020) Global R&D funding forecast – special mid-year update part 1. R&D World. https://www.rdworldonline.com/global-rd-funding-forecast-special-mid-year-update-part-1/

Taylor & Francis Online (2019) 2020 R&D trends forecast. Results from the innovation research interchange’s annual survey. https://www.tandfonline.com/doi/abs/10.1080/08956308.2019.1686287?journalCode=urtm20

Statista (2020) Distribution of research and development (R&D) spending worldwide from 2017 to 2020, by country/region. https://www.statista.com/statistics/732224/worldwide-research-and-development-distribution-of-investment/

United Nations Educational, Scientific and Cultural Organization Institute for Statistics (2020) How much does your country invest in R&D? http://uis.unesco.org/apps/visualisations/research-and-development-spending/

Organization for Economic Co-operation and Development Data (2020) Gross domestic spending on R&D. https://data.oecd.org/rd/gross-domestic-spending-on-r-d.htm

World Factbook, Central Intelligence (2020) Agency country comparison: military expenditure. https://www.cia.gov/library/publications/the-world-factbook/rankorder/2034rank.html

P Wikipedia (2020) Precautionary principle. https://en.wikipedia.org/wiki/Precautionary_principle

United Nations Educational, Scientific and Cultural Organization (2005) The Precautionary Principle. World Commission on the Ethics of Scientific Knowledge and Technology (COMEST). https://www.eubios.info/UNESCO/precprin.pdf

Zabalawi I, Floden IT (2019) The diploma supplement as a tool for quality assurance and relevance. In: Badran A et al (eds) Major challenges facing higher education in the Arab world: quality assurance and relevance. Springer, Cham, pp 237–255. https://doi.org/10.1007/978-3-030-03774-1_12

Centre for Data Ethics and Innovation (2020) Department for Digital, Culture, Media & Sport, UK Government. https://www.gov.uk/government/organisations/centre-for-data-ethics-and-innovation

The Council for Awards of Royal Agricultural Societies (2020). https://royalagriculturalsocietiesawards.org/

Parry M (2020) Science and technology parks and universities – facing the next industrial revolution. In: Badran A et al (eds) Higher education in the Arab world: building a culture of innovation and entrepreneurship. Springer, Cham, pp 109–140. https://doi.org/10.1007/978-3-030-37834-9_5

Download references

Author information

Authors and affiliations.

Department of Biology, American University of Beirut, Beirut, Lebanon

Elias Baydoun & Joelle Mesmar

Department of Business Administration, Beirut Arab University, Beirut, Lebanon

Abdul Rahman Beydoun

James Hutton Institute, Dundee, UK

John R. Hillman

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Elias Baydoun .

Editor information

Editors and affiliations.

Chancellor Office, University of Petra, Amman, Jordan

Adnan Badran

Elias Baydoun

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Baydoun, E., Mesmar, J., Beydoun, A.R., Hillman, J.R. (2022). An Overview of Research and Development in Academia. In: Badran, A., Baydoun, E., Hillman, J.R. (eds) Higher Education in the Arab World: Research and Development. Springer, Cham. https://doi.org/10.1007/978-3-030-80122-9_2

Download citation

DOI : https://doi.org/10.1007/978-3-030-80122-9_2

Published : 03 February 2022

Publisher Name : Springer, Cham

Print ISBN : 978-3-030-80121-2

Online ISBN : 978-3-030-80122-9

eBook Packages : Education Education (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Publish with us

Policies and ethics

  • Find a journal
  • Track your research

This is “An Introduction to Research and Development (R&D)”, section 13.1 from the book Challenges and Opportunities in International Business (v. 1.0). For details on it (including licensing), click here .

This book is licensed under a Creative Commons by-nc-sa 3.0 license. See the license for more details, but that basically means you can share this book as long as you credit the author (but see below), don't make money from it, and do make it available to everyone else under the same terms.

This content was accessible as of December 29, 2012, and it was downloaded then by Andy Schmitz in an effort to preserve the availability of this book.

Normally, the author and publisher would be credited here. However, the publisher has asked for the customary Creative Commons attribution to the original publisher, authors, title, and book URI to be removed. Additionally, per the publisher's request, their name has been removed in some passages. More information is available on this project's attribution page .

For more information on the source of this book, or why it is available for free, please see the project's home page . You can browse or download additional books there. To download a .zip file containing this book to use offline, simply click here .

research in development pdf

13.1 An Introduction to Research and Development (R&D)

Learning objectives.

  • Know what constitutes research and development (R&D).
  • Understand the importance of R&D to corporations.
  • Recognize the role government plays in R&D.

Research and development (R&D) The intertwined processes of research (to identify new knowledge and ideas) and development (turning the ideas into tangible products or processes). refers to two intertwined processes of research (to identify new knowledge and ideas) and development (turning the ideas into tangible products or processes). Companies undertake R&D in order to develop new products, services, or procedures that will help them grow and expand their operations. Corporate R&D began in the United States with Thomas Edison and the Edison General Electric Company he founded in 1890 (which is today’s GE). Edison is credited with 1,093 patents, but it’s actually his invention of the corporate R&D lab that made all those other inventions possible. Andrea Meyer, “High-Value Innovation: Innovating the Management of Innovation,” Working Knowledge (blog), August 20, 2009, accessed February 22, 2011, http://workingknowledge.com/blog/?p=594 . Edison was the first to bring management discipline to R&D, which enabled a much more powerful method of invention by systematically harnessing the talent of many individuals. Edison’s 1,093 patents had less to do with individual genius and more to do with management genius: creating and managing an R&D lab that could efficiently and effectively crank out new inventions. For fifty years following the early twentieth century, GE was awarded more patents than any other firm in America. Gary Hamel, “The Why, What and How of Management Innovation,” Harvard Business Review , February 2006, accessed February 24, 2011, http://hbr.org/2006/02/the-why-what-and-how-of-management-innovation/ar/1 .

Edison is known as an inventor, but he was also a great innovator. Here’s the difference: an invention Brings an idea into tangible reality by embodying it as a product or process. brings an idea into tangible reality by embodying it as a product or system. An innovation Generates revenue from a product or process. converts a new idea into revenues and profits. Inventors can get patents on original ideas, but those inventions may not make money. For an invention to become an innovation, people must be willing to buy it in high enough numbers that the firm benefits from making it. A. G. Lafley and Ram Charan, The Game-Changer (New York: Crown Publishing Group, 2008), 21.

Edison wanted his lab to be a commercial success. “Anything that won’t sell, I don’t want to invent. Its sale is proof of utility and utility is success,” A. G. Lafley and Ram Charan, The Game-Changer (New York: Crown Publishing Group, 2008), 25. Edison said. Edison’s lab in Menlo Park, New Jersey, was an applied research The systematic work to gain knowledge to meet a specific need. lab, which is a lab that develops and commercializes its research findings. As defined by the National Science Foundation, applied research is “systematic study to gain knowledge or understanding necessary to determine the means by which a recognized and specific need may be met.” National Science Foundation, “Definitions of Research and Development,” Office of Management and Budget Circular A-11, accessed March 5, 2011, http://www.nsf.gov/statistics/randdef/fedgov.cfm . In contrast, basic research The work of scientists and others who pursue their investigations without commercial goals, focusing on unraveling the secrets of nature and finding new knowledge. advances the knowledge of science without an explicit, anticipated commercial outcome.

History and Importance

From Edison’s lab onward, companies learned that a systematic approach to research could provide big competitive advantages. Companies could not only invent new products, but they could also turn those inventions into innovations that launched whole new industries. For example, the radio, wireless communications, and television industry grew out of early-twentieth-century research by General Electric and American Telephone and Telegraph (AT&T, which founded Bell Labs).

The heyday of American R&D labs came in the 1950s and early 1960s, with corporate institutions like Bell Labs, RCA labs, IBM’s research centers, and government institutions such as NASA and DARPA. These labs funded both basic and applied research, giving birth to the transistor, long-distance TV transmission, photovoltaic solar cells, the UNIX operating system, and cellular telephony, each of which led to the creation of not just hundreds of products but whole industries and millions of jobs. Adrian Slywotzky, “How Science Can Create Millions of New Jobs,” BusinessWeek , September 7, 2009, accessed May 11, 2011, http://www.businessweek.com/magazine/content/09_36/b4145036678131.htm . DARPA’s creation of the Internet (known at its inception as ARPAnet) and Xerox PARC’s Ethernet and graphical-user interface (GUI) laid the foundations for the PC revolution. Adrian Slywotzky, “How Science Can Create Millions of New Jobs,” BusinessWeek , September 7, 2009, accessed May 11, 2011, http://www.businessweek.com/magazine/content/09_36/b4145036678131.htm .

research in development pdf

© 2011 IBM Corporation

Companies invest in R&D to gain a pipeline of new products. For a high-tech company like Apple, it means coming up with new types of products (e.g., the iPad) as well as newer and better versions of its existing computers and iPhones. For a pharmaceutical company, it means coming out with new drugs to treat diseases. Different parts of the world have different diseases or different forms of known diseases. For example, diabetes in China has a different molecular structure than diabetes elsewhere in the world, and pharmaceutical company Eli Lilly’s new R&D center in Shanghai will focus on this disease variant. “2011 Global R&D Funding Forecast,” R&D Magazine , December 2010, accessed February 27, 2011, http://www.battelle.org/aboutus/rd/2011.pdf . Even companies that sell only services benefit from innovation and developing new services. For example, MasterCard Global Service started providing customers with emergency cash advances, directions to nearby ATMs, and emergency card replacements. Lance Bettencourt, Service Innovation (New York: McGraw-Hill, 2010), 99.

Innovation also includes new product and service combinations. For example, heavy-equipment manufacturer John Deere created a product and service combination by equipping a GPS into one of its tractors. The GPS keeps the tractor on a parallel path, even under hands-free operation, and keeps the tractor with only a two-centimeter overlap of those parallel lines. This innovation helps a farmer increase the yield of the field and complete passes over the field in the tractor more quickly. The innovation also helps reduce fuel, seed, and chemical costs because there is little overlap and waste of the successive parallel passes. Lance Bettencourt, Service Innovation (New York: McGraw-Hill, 2010), 110.

Did You Know?

Appliance maker Whirlpool has made innovation a strategic priority in order to stay competitive. Whirlpool has an innovation pipeline that currently numbers close to 1,000 new products. On average, Whirlpool introduces one hundred new products to the market each year. “Every month we report pipeline size measured by estimated sales, and our goal this year is $4 billion,” said Moises Norena, director of global innovation at Whirlpool. With Whirlpool’s 2008 revenue totaling $18.9 billion, that means roughly 20 percent of sales would be from new products. Jessie Scanlon, “How Whirlpool Puts New Ideas through the Wringer,” BusinessWeek , August 3, 2009, accessed January 17, 2011, http://www.businessweek.com/innovate/content/aug2009/id2009083_452757.htm .

Not only do companies benefit from investing in R&D, but the nation’s economy benefits as well, as Massachusetts Institute of Technology (MIT) professor Robert Solow discovered. Solow showed mathematically that, in the long run, growth in gross national product per worker is due more to technological progress than to mere capital investment. Solow won a Nobel Prize for his research, and investment in corporate R&D labs grew.

Although R&D has its roots in national interests, it has become globalized. Most US and European Fortune 1000 companies have R&D centers in Asia. “2011 Global R&D Funding Forecast,” R&D Magazine , December 2010, accessed February 27, 2011, http://www.battelle.org/aboutus/rd/2011.pdf . You’ll see the reasons for the globalization of R&D in Section 13.3 "How to Organize and Where to Locate Research and Development Activities" .

The Role of Government

Governments have played a large role in the inception of R&D, mainly to fund research for military applications for war efforts. Today, governments still play a big role in innovation because of their ability to fund R&D. A government can fund R&D directly, by offering grants to universities and research centers or by offering contracts to corporations for performing research in a specific area.

Governments can also provide tax incentives for companies that invest in R&D. Countries vary in the tax incentives that they give to corporations that invest in R&D. By giving corporations a tax credit when they invest in R&D, governments encourage corporations to invest in R&D in their countries. For example, Australia gave a 125 percent tax deduction for R&D expenses. The Australian government’s website noted, “It’s little surprise then, that many companies from around the world are choosing to locate their R&D facilities in Australia.” The government also pointed out that “50 percent of the most innovative companies in Australia are foreign-based.” Committee on Prospering in the Global Economy of the 21st Century (U.S.), Committee on Science, Engineering, and Public Policy (U.S.), Rising Above the Gathering Storm (Washington, DC: National Academies Press, 2007), 195.

Finally, governments can promote innovation through investments in infrastructure that will support new technology and by committing to buy the new technology. China is doing this in a big way, and it is thus influencing the course of many companies around the world. Since 2000, China has had a policy in place “to encourage tech transfer from abroad and to force foreign companies to transfer their R&D operations to China in exchange for access to China’s large volume markets,” reported R&D Magazine in its 2010 review of global R&D. “2011 Global R&D Funding Forecast,” R&D Magazine , December 2010, accessed February 27, 2011, http://www.battelle.org/aboutus/rd/2011.pdf . For example, any automobile manufacturer that wants to sell cars in China must enter into a partnership with a Chinese company. As a result, General Motors (GM), Daimler, Hyundai, Volkswagen (VW), and Toyota have all formed joint ventures with Chinese companies. General Motors and Volkswagen, for example, have both formed joint ventures with the Chinese company Shanghai Automotive Industry Corporation (SAIC), even though SAIC also sells cars under its own brand. Brian Dumaine, “China Charges into Electric Cars,” Fortune , November 1, 2010, 140. The Chinese government made another strategic decision influencing innovation in the automobile industry. Because no Chinese company is a leader in internal combustion engines, the government decided to leapfrog the technology and focus on becoming a leader in electric cars. Bill Russo, Tao Ke, Edward Tse, and Bill Peng, China’s Next Revolution: Transforming The Global Auto Industry , Booz & Company report, 2010, accessed February 27, 2011, http://www.booz.com/media/file/China’s_Next_Revolution_en.pdf . “Beijing has pledged that it will do whatever it takes to help the Chinese car industry take the lead in electric vehicles,” notes industry watcher Brian Dumaine. Brian Dumaine, “China Charges into Electric Cars,” Fortune , November 1, 2010, 140. That includes allocating $8 billion in R&D funds as well as another $10 billion in infrastructure (e.g., installing charging stations). Gordon Orr, “Unleashing Innovation in China,” McKinsey Quarterly , January 2011, accessed January 2, 2011, https://www.mckinseyquarterly.com/Strategy/Innovation/Unleashing_innovation_in_China_2725 . The government will also subsidize the purchase of electric cars by consumers and has committed to buying electric cars for government fleets, thus guaranteeing that there will be buyers for the new electric vehicles that companies invent and develop.

Another role of government is to set high targets that require innovation. In the 1960s, the US Apollo space program launched by President John F. Kennedy inspired US corporations to work toward putting a man on the moon. The government’s investments in the Apollo program sped up the development of computer and communications technology and also led to innovations in fuel cells, water purification, freeze-drying food, and digital image processing now used in medical products for CAT scans and MRIs. Adrian Slywotzky, “How Science Can Create Millions of New Jobs,” BusinessWeek , September 7, 2009, accessed May 11, 2011, http://www.businessweek.com/magazine/content/09_36/b4145036678131.htm . Today, government policies coming from the European Union mandate ambitious environmental targets, such as carbon-neutral fuels and energy, which are driving global R&D to achieve environmental goals the way the Apollo program drove R&D in the 1960s. Martin Grueber and Tim Studt, “A Battelle Perspective on Investing in International R&D,” R&D Magazine , December 22, 2009, http://www.rdmag.com/Featured-Articles/2009/12/Global-Funding-Forecast-A-Battelle-Perspective-International-R-D .

After the 1990s, US investment in R&D declined, especially in basic research. Governments in other countries, however, continue to invest. New government-corporate partnerships are developing around the world. IBM, which for years closely guarded its R&D labs (even IBM employees were required to have special badges to enter the R&D area), is now setting up “collaboratories” around the world. These collaboratories are partnerships between IBM researchers and outside experts from government, universities, and even other companies. “The world is our lab now,” says John E. Kelly III, director of IBM Research. Steve Hamm, “How Big Blue Is Forging Cutting-edge Partnerships around the World,” BusinessWeek , August 27, 2009, accessed January 2, 2010, http://www.businessweek.com/print/magazine/content/09_36/b4145040683083.htm . IBM has deals for six future collaboratories in China, Ireland, Taiwan, Switzerland, India, and Saudi Arabia.

The reason for the collaboratory strategy is to share R&D costs—IBM’s partners must share 50 percent of the funding costs, which means that together the partners can participate in a large-scale effort that they’d be hard pressed to fund on their own. An example is IBM’s research partnership with the state-funded Swiss university ETH Zurich. The two are building a $70 million semiconductor lab for nanotech research with the goal of identifying a replacement for the current semiconductor-switch technology. Steve Hamm, “How Big Blue Is Forging Cutting-Edge Partnerships around the World,” BusinessWeek , August 27, 2009, accessed January 2, 2010, http://www.businessweek.com/print/magazine/content/09_36/b4145040683083.htm . Such a breakthrough could harken the creation of a whole new industry.

Of all the countries in the world, the United States remains the largest investor in R&D. One-third of all spending on R&D comes from the United States. Just one government agency—the Department of Defense—provides more funding than all the nations of the world except China and Japan. Nonetheless, other countries are increasing the amounts of money they spend on R&D. Their governments are funding R&D at higher levels and are giving more attractive tax incentives to firms that spend on R&D.

Governments can also play a big role in the protection of intellectual property rights, as you’ll see in Section 13.2 "Intellectual Property Rights around the Globe" .

Key Takeaways

  • R&D refers to two intertwined processes of research (to identify new facts and ideas) and development (turning the ideas into tangible products and services.) Companies undertake R&D to get a pipeline of new products. Breakthrough innovations can create whole new industries, which can provide thousands of jobs.
  • Invention is the creation of a new idea embodied in a product or process, while innovation takes that new idea and commercializes it in a way that enables a company to generate revenue from it.
  • Government support of R&D plays a significant role in innovation. It has been generally accepted that it’s desirable to encourage R&D for reasons of economic growth as well as national security. This has resulted in massive support from public funds for many sorts of laboratories. Governments influence R&D not only by providing direct funding but also by providing tax incentives to companies that invest in R&D. Governments also stimulate innovation through supporting institutions such as education and providing reliable infrastructure.

(AACSB: Reflective Thinking, Analytical Skills)

  • What benefits does a company get by investing in R&D?
  • Why do organizations make a distinction between basic research and applied research?
  • Describe three ways in which government can influence R&D.

research in development pdf

KPMG Logo

  • Global (EN)
  • Albania (en)
  • Algeria (fr)
  • Argentina (es)
  • Armenia (en)
  • Australia (en)
  • Austria (de)
  • Austria (en)
  • Azerbaijan (en)
  • Bahamas (en)
  • Bahrain (en)
  • Bangladesh (en)
  • Barbados (en)
  • Belgium (en)
  • Belgium (nl)
  • Bermuda (en)
  • Bosnia and Herzegovina (en)
  • Brasil (pt)
  • Brazil (en)
  • British Virgin Islands (en)
  • Bulgaria (en)
  • Cambodia (en)
  • Cameroon (fr)
  • Canada (en)
  • Canada (fr)
  • Cayman Islands (en)
  • Channel Islands (en)
  • Colombia (es)
  • Costa Rica (es)
  • Croatia (en)
  • Cyprus (en)
  • Czech Republic (cs)
  • Czech Republic (en)
  • DR Congo (fr)
  • Denmark (da)
  • Denmark (en)
  • Ecuador (es)
  • Estonia (en)
  • Estonia (et)
  • Finland (fi)
  • France (fr)
  • Georgia (en)
  • Germany (de)
  • Germany (en)
  • Gibraltar (en)
  • Greece (el)
  • Greece (en)
  • Hong Kong SAR (en)
  • Hungary (en)
  • Hungary (hu)
  • Iceland (is)
  • Indonesia (en)
  • Ireland (en)
  • Isle of Man (en)
  • Israel (en)
  • Ivory Coast (fr)
  • Jamaica (en)
  • Jordan (en)
  • Kazakhstan (en)
  • Kazakhstan (kk)
  • Kazakhstan (ru)
  • Kuwait (en)
  • Latvia (en)
  • Latvia (lv)
  • Lebanon (en)
  • Lithuania (en)
  • Lithuania (lt)
  • Luxembourg (en)
  • Macau SAR (en)
  • Malaysia (en)
  • Mauritius (en)
  • Mexico (es)
  • Moldova (en)
  • Monaco (en)
  • Monaco (fr)
  • Mongolia (en)
  • Montenegro (en)
  • Mozambique (en)
  • Myanmar (en)
  • Namibia (en)
  • Netherlands (en)
  • Netherlands (nl)
  • New Zealand (en)
  • Nigeria (en)
  • North Macedonia (en)
  • Norway (nb)
  • Pakistan (en)
  • Panama (es)
  • Philippines (en)
  • Poland (en)
  • Poland (pl)
  • Portugal (en)
  • Portugal (pt)
  • Romania (en)
  • Romania (ro)
  • Saudi Arabia (en)
  • Serbia (en)
  • Singapore (en)
  • Slovakia (en)
  • Slovakia (sk)
  • Slovenia (en)
  • South Africa (en)
  • Sri Lanka (en)
  • Sweden (sv)
  • Switzerland (de)
  • Switzerland (en)
  • Switzerland (fr)
  • Taiwan (en)
  • Taiwan (zh)
  • Thailand (en)
  • Trinidad and Tobago (en)
  • Tunisia (en)
  • Tunisia (fr)
  • Turkey (en)
  • Turkey (tr)
  • Ukraine (en)
  • Ukraine (ru)
  • Ukraine (uk)
  • United Arab Emirates (en)
  • United Kingdom (en)
  • United States (en)
  • Uruguay (es)
  • Uzbekistan (en)
  • Uzbekistan (ru)
  • Venezuela (es)
  • Vietnam (en)
  • Vietnam (vi)
  • Zambia (en)
  • Zimbabwe (en)
  • Financial Reporting View
  • Women's Leadership
  • Corporate Finance
  • Board Leadership
  • Executive Education

Fresh thinking and actionable insights that address critical issues your organization faces.

  • Insights by Industry
  • Insights by Topic

KPMG's multi-disciplinary approach and deep, practical industry knowledge help clients meet challenges and respond to opportunities.

  • Advisory Services
  • Audit Services
  • Tax Services

Services to meet your business goals

Technology Alliances

KPMG has market-leading alliances with many of the world's leading software and services vendors.

Helping clients meet their business challenges begins with an in-depth understanding of the industries in which they work. That’s why KPMG LLP established its industry-driven structure. In fact, KPMG LLP was the first of the Big Four firms to organize itself along the same industry lines as clients.

  • Our Industries

How We Work

We bring together passionate problem-solvers, innovative technologies, and full-service capabilities to create opportunity with every insight.

  • What sets us apart

Careers & Culture

What is culture? Culture is how we do things around here. It is the combination of a predominant mindset, actions (both big and small) that we all commit to every day, and the underlying processes, programs and systems supporting how work gets done.

Relevant Results

Sorry, there are no results matching your search..

  • Topic Areas

Reference Library

Handbook: Research and development

Handbooks | August 2023

Latest edition: Our in-depth guide to accounting for R&D costs and R&D funding arrangements.

research in development pdf

Using Q&As and examples, KPMG provides interpretive guidance on research and development costs and funding arrangements.

Applicability

  • All companies engaged in R&D activities

Relevant dates

  • Effective immediately

The many connections of R&D accounting

US GAAP covers two distinct areas of accounting related to R&D: how to account for costs an entity incurs in its R&D activities, and how parties to an R&D funding arrangement account for that arrangement.

The FASB’s guidance has been around a long time – the guidance on R&D costs dates back to 1974 and FASB Statement No. 2, while the guidance on R&D funding arrangements dates back to 1982. Since then, the guidance has remained largely – although not entirely – unchanged.

As businesses look for new ways to innovate and finance their R&D activities, application questions continue to emerge. Our objective with this publication is to help you make the judgments associated with these application issues. We start with the basics of R&D accounting and expand to provide insights, examples and perspectives based on our years of experience in this area.

There are many connections to other accounting topics, and we identify common issues that will require you to consult our handbooks on other Topics, such as business combinations, consolidation, software and website costs, debt and equity financing, and derivatives and hedging.

Viewed from that angle, this one resource provides you with a roadmap to resolving the many varied issues that can arise with R&D activities.

Report contents

  • R&D costs
  • R&D funding arrangements

Download the document:

Research and development

Executive Summary

Explore more

research in development pdf

Handbook: Asset acquisitions

Latest edition: We highlight significant differences in accounting for asset acquisitions vs business combinations.

research in development pdf

Handbook: Business combinations

Latest edition: Our in-depth guide to accounting for acquisitions of businesses, updated for recent application issues.

research in development pdf

In-depth analysis, examples and insights to give you an advantage in understanding the requirements and implications of financial reporting issues.

Meet our team

Image of Nick Burgmeier

Subscribe to stay informed

Receive the latest financial reporting and accounting updates with our newsletters and more delivered to your inbox.

Choose your subscription (select all that apply)

By submitting, you agree that KPMG LLP may process any personal information you provide pursuant to KPMG LLP's Privacy Statement .

Accounting Research Online

Access our accounting research website for additional resources for your financial reporting needs.

Thank you for contacting KPMG. We will respond to you as soon as possible.

Contact KPMG

Job seekers

Visit our careers section or search our jobs database.

Use the RFP submission form to detail the services KPMG can help assist you with.

Office locations

International hotline

You can confidentially report concerns to the KPMG International hotline

Press contacts

Do you need to speak with our Press Office? Here's how to get in touch.

  • Scientific guidelines

The Agency strongly encourages applicants and marketing authorisation holders to follow these guidelines. Applicants need to justify deviations from guidelines fully in their applications at the time of submission. Before that, they should seek scientific advice , to discuss any proposed deviations during medicine development.

The guidelines are complementary to European Pharmacopoeia monographs and chapters:

Status of EMEA scientific guidelines and European pharmacopoeia monographs and chapters in the regulatory framework applicable to medicinal products

Also on this topic

Search guidelines.

  • Biological guidelines
  • Clinical efficacy and safety guidelines
  • Clinical pharmacology and pharmacokinetics
  • ICH guidelines
  • Multidisciplinary guidelines
  • Non-clinical guidelines
  • Quality of medicines Q&A - Introduction
  • Quality guidelines

Compilation of European Commission and Agency guidelines

This section of the website updates and replaces the previous volume 3 of the rules governing medicinal products in the European Union (EudraLex) , published by the European Commission.

The presentational order of the guidelines in this compilation was adapted following the introduction of the Common Technical Document (CTD) format in the EU. 

The individual sections, and the rationale applied to each, are listed below (while the overall structure of Annex I to Directive 2001/83/EC has been followed, some adjustments have been made to account for the specific nature of certain areas or guidelines):

Search for scientific guidelines  by category, type, topic and date.

Biologicals

Biological guidelines  include information on active substance and finished product.

Because of the particular nature of these guidelines, the detailed CTD structure is not entirely applicable. Therefore, a distinction between biologicals, plasma-derived products and vaccines has also been added within the section 'manufacture, characterisation and control of the drug substance'.

Clinical efficacy and safety

Clinical efficacy and safety guidelines  include information on various topics, from dermatologicals to biostatistics

Generally, the CTD structure has been followed. In addition, guidelines have been organised into therapeutic groups.

Herbal medicinal product guidelines

The Committee on Herbal Medicinal Products (HMPC) establishes EU herbal monographs (formerly Community herbal monographs). It also prepares the European Union list of herbal substances, preparations and combinations thereof, for use in traditional herbal medicinal products (formerly the Community list of herbal substances, preparations and combinations thereof for use in traditional herbal medicinal products).

Although these documents are outside the scope of the procedure for EU guidelines, they are relevant for the registration and authorisation of herbal medicinal products.

The HMPC also establishes scientific EU guidelines addressing specific aspects and challenges with herbal medicinal products, particularly in the quality and safety areas. They are listed under a specific heading among multidisciplinary guidelines.

International Conference for Harmonisation (ICH) guidelines  include information on quality, safety, efficacy and other topics.

These guidelines are harmonised through the The International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use . The CTD structure has been followed.

Multidisciplinary

Multidisciplinary guidelines  include information on biosimilars and other topics, from paediatrics to pharmacogenomics. 

These guidelines apply to more than one specific area or have been prepared through the collaboration of several working parties. Where applicable, they are also listed in their related section (e.g. the 'quality' section).

Non-clinical

Non-clinical guidelines  include information on various topics, from toxicology to environmetnal risk assessment

The CTD structure has been followed.

Quality of medicines: questions and answers  features answers to questions brought to the attention of the Quality Working Party (QWP) by marketing authorisation holders and/or EEA competent authorities

Quality guidelines  include information on various topics, from active substance to lifecycle management.

As far as possible, CTD structure has been upheld. It has also been adapted - a different method of consolidation was considered to be more appropriate, as in the case of guidelines which apply to both the active substance and to the finished product (which, in the CTD format, are independent headings).

Related document types

The compilation of European Commission and Agency guidelines contains:

  • all valid guidelines originally published in volume 3;
  • all valid guidelines published by the Agency since 1995;
  • these guidelines' revisions and supplements.

Depending on each guideline's status, one or more of the following documents are available:

  • concept paper;
  • draft guideline;
  • overview of comments received during the consultation period;
  • adopted guideline.

However, only adopted guidelines form part of volume 3 of EudraLex.

Historical documents such as 'notes for guidance' are included in the compilation where they have the regulatory status of a guideline. Following the implementation of the procedure on EU guidelines, however, the use of these terms has been discontinued.

The compilation also includes other related documents, such as reflection papers , public statements and questions and answers . They provide additional information on topics of particular concern and/or clarification in areas where scientific knowledge is fast evolving or experience is limited.

Other guidelines, such as regulatory guidelines, good-manufacturing-practice guidelines and pharmacovigilance guidelines, were excluded from this re-organisation exercise. They continue to be published by the European Commission.

Related content

Related eu legislation, related documents.

Procedure for European Union guidelines and related documents within the pharmaceutical legislative framework

Overview of comments received on draft guideline procedure for EU guidelines and related documents within the pharmaceutical legislative framework

  • Regulatory and procedural guidance

Share this page

How useful do you find this page.

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • My Account Login
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Open access
  • Published: 26 March 2024

Predicting and improving complex beer flavor through machine learning

  • Michiel Schreurs   ORCID: orcid.org/0000-0002-9449-5619 1 , 2 , 3   na1 ,
  • Supinya Piampongsant 1 , 2 , 3   na1 ,
  • Miguel Roncoroni   ORCID: orcid.org/0000-0001-7461-1427 1 , 2 , 3   na1 ,
  • Lloyd Cool   ORCID: orcid.org/0000-0001-9936-3124 1 , 2 , 3 , 4 ,
  • Beatriz Herrera-Malaver   ORCID: orcid.org/0000-0002-5096-9974 1 , 2 , 3 ,
  • Christophe Vanderaa   ORCID: orcid.org/0000-0001-7443-5427 4 ,
  • Florian A. Theßeling 1 , 2 , 3 ,
  • Łukasz Kreft   ORCID: orcid.org/0000-0001-7620-4657 5 ,
  • Alexander Botzki   ORCID: orcid.org/0000-0001-6691-4233 5 ,
  • Philippe Malcorps 6 ,
  • Luk Daenen 6 ,
  • Tom Wenseleers   ORCID: orcid.org/0000-0002-1434-861X 4 &
  • Kevin J. Verstrepen   ORCID: orcid.org/0000-0002-3077-6219 1 , 2 , 3  

Nature Communications volume  15 , Article number:  2368 ( 2024 ) Cite this article

41k Accesses

778 Altmetric

Metrics details

  • Chemical engineering
  • Gas chromatography
  • Machine learning
  • Metabolomics
  • Taste receptors

The perception and appreciation of food flavor depends on many interacting chemical compounds and external factors, and therefore proves challenging to understand and predict. Here, we combine extensive chemical and sensory analyses of 250 different beers to train machine learning models that allow predicting flavor and consumer appreciation. For each beer, we measure over 200 chemical properties, perform quantitative descriptive sensory analysis with a trained tasting panel and map data from over 180,000 consumer reviews to train 10 different machine learning models. The best-performing algorithm, Gradient Boosting, yields models that significantly outperform predictions based on conventional statistics and accurately predict complex food features and consumer appreciation from chemical profiles. Model dissection allows identifying specific and unexpected compounds as drivers of beer flavor and appreciation. Adding these compounds results in variants of commercial alcoholic and non-alcoholic beers with improved consumer appreciation. Together, our study reveals how big data and machine learning uncover complex links between food chemistry, flavor and consumer perception, and lays the foundation to develop novel, tailored foods with superior flavors.

Similar content being viewed by others

research in development pdf

BitterSweet: Building machine learning models for predicting the bitter and sweet taste of small molecules

Rudraksh Tuwani, Somin Wadhwa & Ganesh Bagler

research in development pdf

Sensory lexicon and aroma volatiles analysis of brewing malt

Xiaoxia Su, Miao Yu, … Tianyi Du

research in development pdf

Predicting odor from molecular structure: a multi-label classification approach

Kushagra Saini & Venkatnarayan Ramanathan

Introduction

Predicting and understanding food perception and appreciation is one of the major challenges in food science. Accurate modeling of food flavor and appreciation could yield important opportunities for both producers and consumers, including quality control, product fingerprinting, counterfeit detection, spoilage detection, and the development of new products and product combinations (food pairing) 1 , 2 , 3 , 4 , 5 , 6 . Accurate models for flavor and consumer appreciation would contribute greatly to our scientific understanding of how humans perceive and appreciate flavor. Moreover, accurate predictive models would also facilitate and standardize existing food assessment methods and could supplement or replace assessments by trained and consumer tasting panels, which are variable, expensive and time-consuming 7 , 8 , 9 . Lastly, apart from providing objective, quantitative, accurate and contextual information that can help producers, models can also guide consumers in understanding their personal preferences 10 .

Despite the myriad of applications, predicting food flavor and appreciation from its chemical properties remains a largely elusive goal in sensory science, especially for complex food and beverages 11 , 12 . A key obstacle is the immense number of flavor-active chemicals underlying food flavor. Flavor compounds can vary widely in chemical structure and concentration, making them technically challenging and labor-intensive to quantify, even in the face of innovations in metabolomics, such as non-targeted metabolic fingerprinting 13 , 14 . Moreover, sensory analysis is perhaps even more complicated. Flavor perception is highly complex, resulting from hundreds of different molecules interacting at the physiochemical and sensorial level. Sensory perception is often non-linear, characterized by complex and concentration-dependent synergistic and antagonistic effects 15 , 16 , 17 , 18 , 19 , 20 , 21 that are further convoluted by the genetics, environment, culture and psychology of consumers 22 , 23 , 24 . Perceived flavor is therefore difficult to measure, with problems of sensitivity, accuracy, and reproducibility that can only be resolved by gathering sufficiently large datasets 25 . Trained tasting panels are considered the prime source of quality sensory data, but require meticulous training, are low throughput and high cost. Public databases containing consumer reviews of food products could provide a valuable alternative, especially for studying appreciation scores, which do not require formal training 25 . Public databases offer the advantage of amassing large amounts of data, increasing the statistical power to identify potential drivers of appreciation. However, public datasets suffer from biases, including a bias in the volunteers that contribute to the database, as well as confounding factors such as price, cult status and psychological conformity towards previous ratings of the product.

Classical multivariate statistics and machine learning methods have been used to predict flavor of specific compounds by, for example, linking structural properties of a compound to its potential biological activities or linking concentrations of specific compounds to sensory profiles 1 , 26 . Importantly, most previous studies focused on predicting organoleptic properties of single compounds (often based on their chemical structure) 27 , 28 , 29 , 30 , 31 , 32 , 33 , thus ignoring the fact that these compounds are present in a complex matrix in food or beverages and excluding complex interactions between compounds. Moreover, the classical statistics commonly used in sensory science 34 , 35 , 36 , 37 , 38 , 39 require a large sample size and sufficient variance amongst predictors to create accurate models. They are not fit for studying an extensive set of hundreds of interacting flavor compounds, since they are sensitive to outliers, have a high tendency to overfit and are less suited for non-linear and discontinuous relationships 40 .

In this study, we combine extensive chemical analyses and sensory data of a set of different commercial beers with machine learning approaches to develop models that predict taste, smell, mouthfeel and appreciation from compound concentrations. Beer is particularly suited to model the relationship between chemistry, flavor and appreciation. First, beer is a complex product, consisting of thousands of flavor compounds that partake in complex sensory interactions 41 , 42 , 43 . This chemical diversity arises from the raw materials (malt, yeast, hops, water and spices) and biochemical conversions during the brewing process (kilning, mashing, boiling, fermentation, maturation and aging) 44 , 45 . Second, the advent of the internet saw beer consumers embrace online review platforms, such as RateBeer (ZX Ventures, Anheuser-Busch InBev SA/NV) and BeerAdvocate (Next Glass, inc.). In this way, the beer community provides massive data sets of beer flavor and appreciation scores, creating extraordinarily large sensory databases to complement the analyses of our professional sensory panel. Specifically, we characterize over 200 chemical properties of 250 commercial beers, spread across 22 beer styles, and link these to the descriptive sensory profiling data of a 16-person in-house trained tasting panel and data acquired from over 180,000 public consumer reviews. These unique and extensive datasets enable us to train a suite of machine learning models to predict flavor and appreciation from a beer’s chemical profile. Dissection of the best-performing models allows us to pinpoint specific compounds as potential drivers of beer flavor and appreciation. Follow-up experiments confirm the importance of these compounds and ultimately allow us to significantly improve the flavor and appreciation of selected commercial beers. Together, our study represents a significant step towards understanding complex flavors and reinforces the value of machine learning to develop and refine complex foods. In this way, it represents a stepping stone for further computer-aided food engineering applications 46 .

To generate a comprehensive dataset on beer flavor, we selected 250 commercial Belgian beers across 22 different beer styles (Supplementary Fig.  S1 ). Beers with ≤ 4.2% alcohol by volume (ABV) were classified as non-alcoholic and low-alcoholic. Blonds and Tripels constitute a significant portion of the dataset (12.4% and 11.2%, respectively) reflecting their presence on the Belgian beer market and the heterogeneity of beers within these styles. By contrast, lager beers are less diverse and dominated by a handful of brands. Rare styles such as Brut or Faro make up only a small fraction of the dataset (2% and 1%, respectively) because fewer of these beers are produced and because they are dominated by distinct characteristics in terms of flavor and chemical composition.

Extensive analysis identifies relationships between chemical compounds in beer

For each beer, we measured 226 different chemical properties, including common brewing parameters such as alcohol content, iso-alpha acids, pH, sugar concentration 47 , and over 200 flavor compounds (Methods, Supplementary Table  S1 ). A large portion (37.2%) are terpenoids arising from hopping, responsible for herbal and fruity flavors 16 , 48 . A second major category are yeast metabolites, such as esters and alcohols, that result in fruity and solvent notes 48 , 49 , 50 . Other measured compounds are primarily derived from malt, or other microbes such as non- Saccharomyces yeasts and bacteria (‘wild flora’). Compounds that arise from spices or staling are labeled under ‘Others’. Five attributes (caloric value, total acids and total ester, hop aroma and sulfur compounds) are calculated from multiple individually measured compounds.

As a first step in identifying relationships between chemical properties, we determined correlations between the concentrations of the compounds (Fig.  1 , upper panel, Supplementary Data  1 and 2 , and Supplementary Fig.  S2 . For the sake of clarity, only a subset of the measured compounds is shown in Fig.  1 ). Compounds of the same origin typically show a positive correlation, while absence of correlation hints at parameters varying independently. For example, the hop aroma compounds citronellol, and alpha-terpineol show moderate correlations with each other (Spearman’s rho=0.39 and 0.57), but not with the bittering hop component iso-alpha acids (Spearman’s rho=0.16 and −0.07). This illustrates how brewers can independently modify hop aroma and bitterness by selecting hop varieties and dosage time. If hops are added early in the boiling phase, chemical conversions increase bitterness while aromas evaporate, conversely, late addition of hops preserves aroma but limits bitterness 51 . Similarly, hop-derived iso-alpha acids show a strong anti-correlation with lactic acid and acetic acid, likely reflecting growth inhibition of lactic acid and acetic acid bacteria, or the consequent use of fewer hops in sour beer styles, such as West Flanders ales and Fruit beers, that rely on these bacteria for their distinct flavors 52 . Finally, yeast-derived esters (ethyl acetate, ethyl decanoate, ethyl hexanoate, ethyl octanoate) and alcohols (ethanol, isoamyl alcohol, isobutanol, and glycerol), correlate with Spearman coefficients above 0.5, suggesting that these secondary metabolites are correlated with the yeast genetic background and/or fermentation parameters and may be difficult to influence individually, although the choice of yeast strain may offer some control 53 .

figure 1

Spearman rank correlations are shown. Descriptors are grouped according to their origin (malt (blue), hops (green), yeast (red), wild flora (yellow), Others (black)), and sensory aspect (aroma, taste, palate, and overall appreciation). Please note that for the chemical compounds, for the sake of clarity, only a subset of the total number of measured compounds is shown, with an emphasis on the key compounds for each source. For more details, see the main text and Methods section. Chemical data can be found in Supplementary Data  1 , correlations between all chemical compounds are depicted in Supplementary Fig.  S2 and correlation values can be found in Supplementary Data  2 . See Supplementary Data  4 for sensory panel assessments and Supplementary Data  5 for correlation values between all sensory descriptors.

Interestingly, different beer styles show distinct patterns for some flavor compounds (Supplementary Fig.  S3 ). These observations agree with expectations for key beer styles, and serve as a control for our measurements. For instance, Stouts generally show high values for color (darker), while hoppy beers contain elevated levels of iso-alpha acids, compounds associated with bitter hop taste. Acetic and lactic acid are not prevalent in most beers, with notable exceptions such as Kriek, Lambic, Faro, West Flanders ales and Flanders Old Brown, which use acid-producing bacteria ( Lactobacillus and Pediococcus ) or unconventional yeast ( Brettanomyces ) 54 , 55 . Glycerol, ethanol and esters show similar distributions across all beer styles, reflecting their common origin as products of yeast metabolism during fermentation 45 , 53 . Finally, low/no-alcohol beers contain low concentrations of glycerol and esters. This is in line with the production process for most of the low/no-alcohol beers in our dataset, which are produced through limiting fermentation or by stripping away alcohol via evaporation or dialysis, with both methods having the unintended side-effect of reducing the amount of flavor compounds in the final beer 56 , 57 .

Besides expected associations, our data also reveals less trivial associations between beer styles and specific parameters. For example, geraniol and citronellol, two monoterpenoids responsible for citrus, floral and rose flavors and characteristic of Citra hops, are found in relatively high amounts in Christmas, Saison, and Brett/co-fermented beers, where they may originate from terpenoid-rich spices such as coriander seeds instead of hops 58 .

Tasting panel assessments reveal sensorial relationships in beer

To assess the sensory profile of each beer, a trained tasting panel evaluated each of the 250 beers for 50 sensory attributes, including different hop, malt and yeast flavors, off-flavors and spices. Panelists used a tasting sheet (Supplementary Data  3 ) to score the different attributes. Panel consistency was evaluated by repeating 12 samples across different sessions and performing ANOVA. In 95% of cases no significant difference was found across sessions ( p  > 0.05), indicating good panel consistency (Supplementary Table  S2 ).

Aroma and taste perception reported by the trained panel are often linked (Fig.  1 , bottom left panel and Supplementary Data  4 and 5 ), with high correlations between hops aroma and taste (Spearman’s rho=0.83). Bitter taste was found to correlate with hop aroma and taste in general (Spearman’s rho=0.80 and 0.69), and particularly with “grassy” noble hops (Spearman’s rho=0.75). Barnyard flavor, most often associated with sour beers, is identified together with stale hops (Spearman’s rho=0.97) that are used in these beers. Lactic and acetic acid, which often co-occur, are correlated (Spearman’s rho=0.66). Interestingly, sweetness and bitterness are anti-correlated (Spearman’s rho = −0.48), confirming the hypothesis that they mask each other 59 , 60 . Beer body is highly correlated with alcohol (Spearman’s rho = 0.79), and overall appreciation is found to correlate with multiple aspects that describe beer mouthfeel (alcohol, carbonation; Spearman’s rho= 0.32, 0.39), as well as with hop and ester aroma intensity (Spearman’s rho=0.39 and 0.35).

Similar to the chemical analyses, sensorial analyses confirmed typical features of specific beer styles (Supplementary Fig.  S4 ). For example, sour beers (Faro, Flanders Old Brown, Fruit beer, Kriek, Lambic, West Flanders ale) were rated acidic, with flavors of both acetic and lactic acid. Hoppy beers were found to be bitter and showed hop-associated aromas like citrus and tropical fruit. Malt taste is most detected among scotch, stout/porters, and strong ales, while low/no-alcohol beers, which often have a reputation for being ‘worty’ (reminiscent of unfermented, sweet malt extract) appear in the middle. Unsurprisingly, hop aromas are most strongly detected among hoppy beers. Like its chemical counterpart (Supplementary Fig.  S3 ), acidity shows a right-skewed distribution, with the most acidic beers being Krieks, Lambics, and West Flanders ales.

Tasting panel assessments of specific flavors correlate with chemical composition

We find that the concentrations of several chemical compounds strongly correlate with specific aroma or taste, as evaluated by the tasting panel (Fig.  2 , Supplementary Fig.  S5 , Supplementary Data  6 ). In some cases, these correlations confirm expectations and serve as a useful control for data quality. For example, iso-alpha acids, the bittering compounds in hops, strongly correlate with bitterness (Spearman’s rho=0.68), while ethanol and glycerol correlate with tasters’ perceptions of alcohol and body, the mouthfeel sensation of fullness (Spearman’s rho=0.82/0.62 and 0.72/0.57 respectively) and darker color from roasted malts is a good indication of malt perception (Spearman’s rho=0.54).

figure 2

Heatmap colors indicate Spearman’s Rho. Axes are organized according to sensory categories (aroma, taste, mouthfeel, overall), chemical categories and chemical sources in beer (malt (blue), hops (green), yeast (red), wild flora (yellow), Others (black)). See Supplementary Data  6 for all correlation values.

Interestingly, for some relationships between chemical compounds and perceived flavor, correlations are weaker than expected. For example, the rose-smelling phenethyl acetate only weakly correlates with floral aroma. This hints at more complex relationships and interactions between compounds and suggests a need for a more complex model than simple correlations. Lastly, we uncovered unexpected correlations. For instance, the esters ethyl decanoate and ethyl octanoate appear to correlate slightly with hop perception and bitterness, possibly due to their fruity flavor. Iron is anti-correlated with hop aromas and bitterness, most likely because it is also anti-correlated with iso-alpha acids. This could be a sign of metal chelation of hop acids 61 , given that our analyses measure unbound hop acids and total iron content, or could result from the higher iron content in dark and Fruit beers, which typically have less hoppy and bitter flavors 62 .

Public consumer reviews complement expert panel data

To complement and expand the sensory data of our trained tasting panel, we collected 180,000 reviews of our 250 beers from the online consumer review platform RateBeer. This provided numerical scores for beer appearance, aroma, taste, palate, overall quality as well as the average overall score.

Public datasets are known to suffer from biases, such as price, cult status and psychological conformity towards previous ratings of a product. For example, prices correlate with appreciation scores for these online consumer reviews (rho=0.49, Supplementary Fig.  S6 ), but not for our trained tasting panel (rho=0.19). This suggests that prices affect consumer appreciation, which has been reported in wine 63 , while blind tastings are unaffected. Moreover, we observe that some beer styles, like lagers and non-alcoholic beers, generally receive lower scores, reflecting that online reviewers are mostly beer aficionados with a preference for specialty beers over lager beers. In general, we find a modest correlation between our trained panel’s overall appreciation score and the online consumer appreciation scores (Fig.  3 , rho=0.29). Apart from the aforementioned biases in the online datasets, serving temperature, sample freshness and surroundings, which are all tightly controlled during the tasting panel sessions, can vary tremendously across online consumers and can further contribute to (among others, appreciation) differences between the two categories of tasters. Importantly, in contrast to the overall appreciation scores, for many sensory aspects the results from the professional panel correlated well with results obtained from RateBeer reviews. Correlations were highest for features that are relatively easy to recognize even for untrained tasters, like bitterness, sweetness, alcohol and malt aroma (Fig.  3 and below).

figure 3

RateBeer text mining results can be found in Supplementary Data  7 . Rho values shown are Spearman correlation values, with asterisks indicating significant correlations ( p  < 0.05, two-sided). All p values were smaller than 0.001, except for Esters aroma (0.0553), Esters taste (0.3275), Esters aroma—banana (0.0019), Coriander (0.0508) and Diacetyl (0.0134).

Besides collecting consumer appreciation from these online reviews, we developed automated text analysis tools to gather additional data from review texts (Supplementary Data  7 ). Processing review texts on the RateBeer database yielded comparable results to the scores given by the trained panel for many common sensory aspects, including acidity, bitterness, sweetness, alcohol, malt, and hop tastes (Fig.  3 ). This is in line with what would be expected, since these attributes require less training for accurate assessment and are less influenced by environmental factors such as temperature, serving glass and odors in the environment. Consumer reviews also correlate well with our trained panel for 4-vinyl guaiacol, a compound associated with a very characteristic aroma. By contrast, correlations for more specific aromas like ester, coriander or diacetyl are underrepresented in the online reviews, underscoring the importance of using a trained tasting panel and standardized tasting sheets with explicit factors to be scored for evaluating specific aspects of a beer. Taken together, our results suggest that public reviews are trustworthy for some, but not all, flavor features and can complement or substitute taste panel data for these sensory aspects.

Models can predict beer sensory profiles from chemical data

The rich datasets of chemical analyses, tasting panel assessments and public reviews gathered in the first part of this study provided us with a unique opportunity to develop predictive models that link chemical data to sensorial features. Given the complexity of beer flavor, basic statistical tools such as correlations or linear regression may not always be the most suitable for making accurate predictions. Instead, we applied different machine learning models that can model both simple linear and complex interactive relationships. Specifically, we constructed a set of regression models to predict (a) trained panel scores for beer flavor and quality and (b) public reviews’ appreciation scores from beer chemical profiles. We trained and tested 10 different models (Methods), 3 linear regression-based models (simple linear regression with first-order interactions (LR), lasso regression with first-order interactions (Lasso), partial least squares regressor (PLSR)), 5 decision tree models (AdaBoost regressor (ABR), extra trees (ET), gradient boosting regressor (GBR), random forest (RF) and XGBoost regressor (XGBR)), 1 support vector regression (SVR), and 1 artificial neural network (ANN) model.

To compare the performance of our machine learning models, the dataset was randomly split into a training and test set, stratified by beer style. After a model was trained on data in the training set, its performance was evaluated on its ability to predict the test dataset obtained from multi-output models (based on the coefficient of determination, see Methods). Additionally, individual-attribute models were ranked per descriptor and the average rank was calculated, as proposed by Korneva et al. 64 . Importantly, both ways of evaluating the models’ performance agreed in general. Performance of the different models varied (Table  1 ). It should be noted that all models perform better at predicting RateBeer results than results from our trained tasting panel. One reason could be that sensory data is inherently variable, and this variability is averaged out with the large number of public reviews from RateBeer. Additionally, all tree-based models perform better at predicting taste than aroma. Linear models (LR) performed particularly poorly, with negative R 2 values, due to severe overfitting (training set R 2  = 1). Overfitting is a common issue in linear models with many parameters and limited samples, especially with interaction terms further amplifying the number of parameters. L1 regularization (Lasso) successfully overcomes this overfitting, out-competing multiple tree-based models on the RateBeer dataset. Similarly, the dimensionality reduction of PLSR avoids overfitting and improves performance, to some extent. Still, tree-based models (ABR, ET, GBR, RF and XGBR) show the best performance, out-competing the linear models (LR, Lasso, PLSR) commonly used in sensory science 65 .

GBR models showed the best overall performance in predicting sensory responses from chemical information, with R 2 values up to 0.75 depending on the predicted sensory feature (Supplementary Table  S4 ). The GBR models predict consumer appreciation (RateBeer) better than our trained panel’s appreciation (R 2 value of 0.67 compared to R 2 value of 0.09) (Supplementary Table  S3 and Supplementary Table  S4 ). ANN models showed intermediate performance, likely because neural networks typically perform best with larger datasets 66 . The SVR shows intermediate performance, mostly due to the weak predictions of specific attributes that lower the overall performance (Supplementary Table  S4 ).

Model dissection identifies specific, unexpected compounds as drivers of consumer appreciation

Next, we leveraged our models to infer important contributors to sensory perception and consumer appreciation. Consumer preference is a crucial sensory aspects, because a product that shows low consumer appreciation scores often does not succeed commercially 25 . Additionally, the requirement for a large number of representative evaluators makes consumer trials one of the more costly and time-consuming aspects of product development. Hence, a model for predicting chemical drivers of overall appreciation would be a welcome addition to the available toolbox for food development and optimization.

Since GBR models on our RateBeer dataset showed the best overall performance, we focused on these models. Specifically, we used two approaches to identify important contributors. First, rankings of the most important predictors for each sensorial trait in the GBR models were obtained based on impurity-based feature importance (mean decrease in impurity). High-ranked parameters were hypothesized to be either the true causal chemical properties underlying the trait, to correlate with the actual causal properties, or to take part in sensory interactions affecting the trait 67 (Fig.  4A ). In a second approach, we used SHAP 68 to determine which parameters contributed most to the model for making predictions of consumer appreciation (Fig.  4B ). SHAP calculates parameter contributions to model predictions on a per-sample basis, which can be aggregated into an importance score.

figure 4

A The impurity-based feature importance (mean deviance in impurity, MDI) calculated from the Gradient Boosting Regression (GBR) model predicting RateBeer appreciation scores. The top 15 highest ranked chemical properties are shown. B SHAP summary plot for the top 15 parameters contributing to our GBR model. Each point on the graph represents a sample from our dataset. The color represents the concentration of that parameter, with bluer colors representing low values and redder colors representing higher values. Greater absolute values on the horizontal axis indicate a higher impact of the parameter on the prediction of the model. C Spearman correlations between the 15 most important chemical properties and consumer overall appreciation. Numbers indicate the Spearman Rho correlation coefficient, and the rank of this correlation compared to all other correlations. The top 15 important compounds were determined using SHAP (panel B).

Both approaches identified ethyl acetate as the most predictive parameter for beer appreciation (Fig.  4 ). Ethyl acetate is the most abundant ester in beer with a typical ‘fruity’, ‘solvent’ and ‘alcoholic’ flavor, but is often considered less important than other esters like isoamyl acetate. The second most important parameter identified by SHAP is ethanol, the most abundant beer compound after water. Apart from directly contributing to beer flavor and mouthfeel, ethanol drastically influences the physical properties of beer, dictating how easily volatile compounds escape the beer matrix to contribute to beer aroma 69 . Importantly, it should also be noted that the importance of ethanol for appreciation is likely inflated by the very low appreciation scores of non-alcoholic beers (Supplementary Fig.  S4 ). Despite not often being considered a driver of beer appreciation, protein level also ranks highly in both approaches, possibly due to its effect on mouthfeel and body 70 . Lactic acid, which contributes to the tart taste of sour beers, is the fourth most important parameter identified by SHAP, possibly due to the generally high appreciation of sour beers in our dataset.

Interestingly, some of the most important predictive parameters for our model are not well-established as beer flavors or are even commonly regarded as being negative for beer quality. For example, our models identify methanethiol and ethyl phenyl acetate, an ester commonly linked to beer staling 71 , as a key factor contributing to beer appreciation. Although there is no doubt that high concentrations of these compounds are considered unpleasant, the positive effects of modest concentrations are not yet known 72 , 73 .

To compare our approach to conventional statistics, we evaluated how well the 15 most important SHAP-derived parameters correlate with consumer appreciation (Fig.  4C ). Interestingly, only 6 of the properties derived by SHAP rank amongst the top 15 most correlated parameters. For some chemical compounds, the correlations are so low that they would have likely been considered unimportant. For example, lactic acid, the fourth most important parameter, shows a bimodal distribution for appreciation, with sour beers forming a separate cluster, that is missed entirely by the Spearman correlation. Additionally, the correlation plots reveal outliers, emphasizing the need for robust analysis tools. Together, this highlights the need for alternative models, like the Gradient Boosting model, that better grasp the complexity of (beer) flavor.

Finally, to observe the relationships between these chemical properties and their predicted targets, partial dependence plots were constructed for the six most important predictors of consumer appreciation 74 , 75 , 76 (Supplementary Fig.  S7 ). One-way partial dependence plots show how a change in concentration affects the predicted appreciation. These plots reveal an important limitation of our models: appreciation predictions remain constant at ever-increasing concentrations. This implies that once a threshold concentration is reached, further increasing the concentration does not affect appreciation. This is false, as it is well-documented that certain compounds become unpleasant at high concentrations, including ethyl acetate (‘nail polish’) 77 and methanethiol (‘sulfury’ and ‘rotten cabbage’) 78 . The inability of our models to grasp that flavor compounds have optimal levels, above which they become negative, is a consequence of working with commercial beer brands where (off-)flavors are rarely too high to negatively impact the product. The two-way partial dependence plots show how changing the concentration of two compounds influences predicted appreciation, visualizing their interactions (Supplementary Fig.  S7 ). In our case, the top 5 parameters are dominated by additive or synergistic interactions, with high concentrations for both compounds resulting in the highest predicted appreciation.

To assess the robustness of our best-performing models and model predictions, we performed 100 iterations of the GBR, RF and ET models. In general, all iterations of the models yielded similar performance (Supplementary Fig.  S8 ). Moreover, the main predictors (including the top predictors ethanol and ethyl acetate) remained virtually the same, especially for GBR and RF. For the iterations of the ET model, we did observe more variation in the top predictors, which is likely a consequence of the model’s inherent random architecture in combination with co-correlations between certain predictors. However, even in this case, several of the top predictors (ethanol and ethyl acetate) remain unchanged, although their rank in importance changes (Supplementary Fig.  S8 ).

Next, we investigated if a combination of RateBeer and trained panel data into one consolidated dataset would lead to stronger models, under the hypothesis that such a model would suffer less from bias in the datasets. A GBR model was trained to predict appreciation on the combined dataset. This model underperformed compared to the RateBeer model, both in the native case and when including a dataset identifier (R 2  = 0.67, 0.26 and 0.42 respectively). For the latter, the dataset identifier is the most important feature (Supplementary Fig.  S9 ), while most of the feature importance remains unchanged, with ethyl acetate and ethanol ranking highest, like in the original model trained only on RateBeer data. It seems that the large variation in the panel dataset introduces noise, weakening the models’ performances and reliability. In addition, it seems reasonable to assume that both datasets are fundamentally different, with the panel dataset obtained by blind tastings by a trained professional panel.

Lastly, we evaluated whether beer style identifiers would further enhance the model’s performance. A GBR model was trained with parameters that explicitly encoded the styles of the samples. This did not improve model performance (R2 = 0.66 with style information vs R2 = 0.67). The most important chemical features are consistent with the model trained without style information (eg. ethanol and ethyl acetate), and with the exception of the most preferred (strong ale) and least preferred (low/no-alcohol) styles, none of the styles were among the most important features (Supplementary Fig.  S9 , Supplementary Table  S5 and S6 ). This is likely due to a combination of style-specific chemical signatures, such as iso-alpha acids and lactic acid, that implicitly convey style information to the original models, as well as the low number of samples belonging to some styles, making it difficult for the model to learn style-specific patterns. Moreover, beer styles are not rigorously defined, with some styles overlapping in features and some beers being misattributed to a specific style, all of which leads to more noise in models that use style parameters.

Model validation

To test if our predictive models give insight into beer appreciation, we set up experiments aimed at improving existing commercial beers. We specifically selected overall appreciation as the trait to be examined because of its complexity and commercial relevance. Beer flavor comprises a complex bouquet rather than single aromas and tastes 53 . Hence, adding a single compound to the extent that a difference is noticeable may lead to an unbalanced, artificial flavor. Therefore, we evaluated the effect of combinations of compounds. Because Blond beers represent the most extensive style in our dataset, we selected a beer from this style as the starting material for these experiments (Beer 64 in Supplementary Data  1 ).

In the first set of experiments, we adjusted the concentrations of compounds that made up the most important predictors of overall appreciation (ethyl acetate, ethanol, lactic acid, ethyl phenyl acetate) together with correlated compounds (ethyl hexanoate, isoamyl acetate, glycerol), bringing them up to 95 th percentile ethanol-normalized concentrations (Methods) within the Blond group (‘Spiked’ concentration in Fig.  5A ). Compared to controls, the spiked beers were found to have significantly improved overall appreciation among trained panelists, with panelist noting increased intensity of ester flavors, sweetness, alcohol, and body fullness (Fig.  5B ). To disentangle the contribution of ethanol to these results, a second experiment was performed without the addition of ethanol. This resulted in a similar outcome, including increased perception of alcohol and overall appreciation.

figure 5

Adding the top chemical compounds, identified as best predictors of appreciation by our model, into poorly appreciated beers results in increased appreciation from our trained panel. Results of sensory tests between base beers and those spiked with compounds identified as the best predictors by the model. A Blond and Non/Low-alcohol (0.0% ABV) base beers were brought up to 95th-percentile ethanol-normalized concentrations within each style. B For each sensory attribute, tasters indicated the more intense sample and selected the sample they preferred. The numbers above the bars correspond to the p values that indicate significant changes in perceived flavor (two-sided binomial test: alpha 0.05, n  = 20 or 13).

In a last experiment, we tested whether using the model’s predictions can boost the appreciation of a non-alcoholic beer (beer 223 in Supplementary Data  1 ). Again, the addition of a mixture of predicted compounds (omitting ethanol, in this case) resulted in a significant increase in appreciation, body, ester flavor and sweetness.

Predicting flavor and consumer appreciation from chemical composition is one of the ultimate goals of sensory science. A reliable, systematic and unbiased way to link chemical profiles to flavor and food appreciation would be a significant asset to the food and beverage industry. Such tools would substantially aid in quality control and recipe development, offer an efficient and cost-effective alternative to pilot studies and consumer trials and would ultimately allow food manufacturers to produce superior, tailor-made products that better meet the demands of specific consumer groups more efficiently.

A limited set of studies have previously tried, to varying degrees of success, to predict beer flavor and beer popularity based on (a limited set of) chemical compounds and flavors 79 , 80 . Current sensitive, high-throughput technologies allow measuring an unprecedented number of chemical compounds and properties in a large set of samples, yielding a dataset that can train models that help close the gaps between chemistry and flavor, even for a complex natural product like beer. To our knowledge, no previous research gathered data at this scale (250 samples, 226 chemical parameters, 50 sensory attributes and 5 consumer scores) to disentangle and validate the chemical aspects driving beer preference using various machine-learning techniques. We find that modern machine learning models outperform conventional statistical tools, such as correlations and linear models, and can successfully predict flavor appreciation from chemical composition. This could be attributed to the natural incorporation of interactions and non-linear or discontinuous effects in machine learning models, which are not easily grasped by the linear model architecture. While linear models and partial least squares regression represent the most widespread statistical approaches in sensory science, in part because they allow interpretation 65 , 81 , 82 , modern machine learning methods allow for building better predictive models while preserving the possibility to dissect and exploit the underlying patterns. Of the 10 different models we trained, tree-based models, such as our best performing GBR, showed the best overall performance in predicting sensory responses from chemical information, outcompeting artificial neural networks. This agrees with previous reports for models trained on tabular data 83 . Our results are in line with the findings of Colantonio et al. who also identified the gradient boosting architecture as performing best at predicting appreciation and flavor (of tomatoes and blueberries, in their specific study) 26 . Importantly, besides our larger experimental scale, we were able to directly confirm our models’ predictions in vivo.

Our study confirms that flavor compound concentration does not always correlate with perception, suggesting complex interactions that are often missed by more conventional statistics and simple models. Specifically, we find that tree-based algorithms may perform best in developing models that link complex food chemistry with aroma. Furthermore, we show that massive datasets of untrained consumer reviews provide a valuable source of data, that can complement or even replace trained tasting panels, especially for appreciation and basic flavors, such as sweetness and bitterness. This holds despite biases that are known to occur in such datasets, such as price or conformity bias. Moreover, GBR models predict taste better than aroma. This is likely because taste (e.g. bitterness) often directly relates to the corresponding chemical measurements (e.g., iso-alpha acids), whereas such a link is less clear for aromas, which often result from the interplay between multiple volatile compounds. We also find that our models are best at predicting acidity and alcohol, likely because there is a direct relation between the measured chemical compounds (acids and ethanol) and the corresponding perceived sensorial attribute (acidity and alcohol), and because even untrained consumers are generally able to recognize these flavors and aromas.

The predictions of our final models, trained on review data, hold even for blind tastings with small groups of trained tasters, as demonstrated by our ability to validate specific compounds as drivers of beer flavor and appreciation. Since adding a single compound to the extent of a noticeable difference may result in an unbalanced flavor profile, we specifically tested our identified key drivers as a combination of compounds. While this approach does not allow us to validate if a particular single compound would affect flavor and/or appreciation, our experiments do show that this combination of compounds increases consumer appreciation.

It is important to stress that, while it represents an important step forward, our approach still has several major limitations. A key weakness of the GBR model architecture is that amongst co-correlating variables, the largest main effect is consistently preferred for model building. As a result, co-correlating variables often have artificially low importance scores, both for impurity and SHAP-based methods, like we observed in the comparison to the more randomized Extra Trees models. This implies that chemicals identified as key drivers of a specific sensory feature by GBR might not be the true causative compounds, but rather co-correlate with the actual causative chemical. For example, the high importance of ethyl acetate could be (partially) attributed to the total ester content, ethanol or ethyl hexanoate (rho=0.77, rho=0.72 and rho=0.68), while ethyl phenylacetate could hide the importance of prenyl isobutyrate and ethyl benzoate (rho=0.77 and rho=0.76). Expanding our GBR model to include beer style as a parameter did not yield additional power or insight. This is likely due to style-specific chemical signatures, such as iso-alpha acids and lactic acid, that implicitly convey style information to the original model, as well as the smaller sample size per style, limiting the power to uncover style-specific patterns. This can be partly attributed to the curse of dimensionality, where the high number of parameters results in the models mainly incorporating single parameter effects, rather than complex interactions such as style-dependent effects 67 . A larger number of samples may overcome some of these limitations and offer more insight into style-specific effects. On the other hand, beer style is not a rigid scientific classification, and beers within one style often differ a lot, which further complicates the analysis of style as a model factor.

Our study is limited to beers from Belgian breweries. Although these beers cover a large portion of the beer styles available globally, some beer styles and consumer patterns may be missing, while other features might be overrepresented. For example, many Belgian ales exhibit yeast-driven flavor profiles, which is reflected in the chemical drivers of appreciation discovered by this study. In future work, expanding the scope to include diverse markets and beer styles could lead to the identification of even more drivers of appreciation and better models for special niche products that were not present in our beer set.

In addition to inherent limitations of GBR models, there are also some limitations associated with studying food aroma. Even if our chemical analyses measured most of the known aroma compounds, the total number of flavor compounds in complex foods like beer is still larger than the subset we were able to measure in this study. For example, hop-derived thiols, that influence flavor at very low concentrations, are notoriously difficult to measure in a high-throughput experiment. Moreover, consumer perception remains subjective and prone to biases that are difficult to avoid. It is also important to stress that the models are still immature and that more extensive datasets will be crucial for developing more complete models in the future. Besides more samples and parameters, our dataset does not include any demographic information about the tasters. Including such data could lead to better models that grasp external factors like age and culture. Another limitation is that our set of beers consists of high-quality end-products and lacks beers that are unfit for sale, which limits the current model in accurately predicting products that are appreciated very badly. Finally, while models could be readily applied in quality control, their use in sensory science and product development is restrained by their inability to discern causal relationships. Given that the models cannot distinguish compounds that genuinely drive consumer perception from those that merely correlate, validation experiments are essential to identify true causative compounds.

Despite the inherent limitations, dissection of our models enabled us to pinpoint specific molecules as potential drivers of beer aroma and consumer appreciation, including compounds that were unexpected and would not have been identified using standard approaches. Important drivers of beer appreciation uncovered by our models include protein levels, ethyl acetate, ethyl phenyl acetate and lactic acid. Currently, many brewers already use lactic acid to acidify their brewing water and ensure optimal pH for enzymatic activity during the mashing process. Our results suggest that adding lactic acid can also improve beer appreciation, although its individual effect remains to be tested. Interestingly, ethanol appears to be unnecessary to improve beer appreciation, both for blond beer and alcohol-free beer. Given the growing consumer interest in alcohol-free beer, with a predicted annual market growth of >7% 84 , it is relevant for brewers to know what compounds can further increase consumer appreciation of these beers. Hence, our model may readily provide avenues to further improve the flavor and consumer appreciation of both alcoholic and non-alcoholic beers, which is generally considered one of the key challenges for future beer production.

Whereas we see a direct implementation of our results for the development of superior alcohol-free beverages and other food products, our study can also serve as a stepping stone for the development of novel alcohol-containing beverages. We want to echo the growing body of scientific evidence for the negative effects of alcohol consumption, both on the individual level by the mutagenic, teratogenic and carcinogenic effects of ethanol 85 , 86 , as well as the burden on society caused by alcohol abuse and addiction. We encourage the use of our results for the production of healthier, tastier products, including novel and improved beverages with lower alcohol contents. Furthermore, we strongly discourage the use of these technologies to improve the appreciation or addictive properties of harmful substances.

The present work demonstrates that despite some important remaining hurdles, combining the latest developments in chemical analyses, sensory analysis and modern machine learning methods offers exciting avenues for food chemistry and engineering. Soon, these tools may provide solutions in quality control and recipe development, as well as new approaches to sensory science and flavor research.

Beer selection

250 commercial Belgian beers were selected to cover the broad diversity of beer styles and corresponding diversity in chemical composition and aroma. See Supplementary Fig.  S1 .

Chemical dataset

Sample preparation.

Beers within their expiration date were purchased from commercial retailers. Samples were prepared in biological duplicates at room temperature, unless explicitly stated otherwise. Bottle pressure was measured with a manual pressure device (Steinfurth Mess-Systeme GmbH) and used to calculate CO 2 concentration. The beer was poured through two filter papers (Macherey-Nagel, 500713032 MN 713 ¼) to remove carbon dioxide and prevent spontaneous foaming. Samples were then prepared for measurements by targeted Headspace-Gas Chromatography-Flame Ionization Detector/Flame Photometric Detector (HS-GC-FID/FPD), Headspace-Solid Phase Microextraction-Gas Chromatography-Mass Spectrometry (HS-SPME-GC-MS), colorimetric analysis, enzymatic analysis, Near-Infrared (NIR) analysis, as described in the sections below. The mean values of biological duplicates are reported for each compound.

HS-GC-FID/FPD

HS-GC-FID/FPD (Shimadzu GC 2010 Plus) was used to measure higher alcohols, acetaldehyde, esters, 4-vinyl guaicol, and sulfur compounds. Each measurement comprised 5 ml of sample pipetted into a 20 ml glass vial containing 1.75 g NaCl (VWR, 27810.295). 100 µl of 2-heptanol (Sigma-Aldrich, H3003) (internal standard) solution in ethanol (Fisher Chemical, E/0650DF/C17) was added for a final concentration of 2.44 mg/L. Samples were flushed with nitrogen for 10 s, sealed with a silicone septum, stored at −80 °C and analyzed in batches of 20.

The GC was equipped with a DB-WAXetr column (length, 30 m; internal diameter, 0.32 mm; layer thickness, 0.50 µm; Agilent Technologies, Santa Clara, CA, USA) to the FID and an HP-5 column (length, 30 m; internal diameter, 0.25 mm; layer thickness, 0.25 µm; Agilent Technologies, Santa Clara, CA, USA) to the FPD. N 2 was used as the carrier gas. Samples were incubated for 20 min at 70 °C in the headspace autosampler (Flow rate, 35 cm/s; Injection volume, 1000 µL; Injection mode, split; Combi PAL autosampler, CTC analytics, Switzerland). The injector, FID and FPD temperatures were kept at 250 °C. The GC oven temperature was first held at 50 °C for 5 min and then allowed to rise to 80 °C at a rate of 5 °C/min, followed by a second ramp of 4 °C/min until 200 °C kept for 3 min and a final ramp of (4 °C/min) until 230 °C for 1 min. Results were analyzed with the GCSolution software version 2.4 (Shimadzu, Kyoto, Japan). The GC was calibrated with a 5% EtOH solution (VWR International) containing the volatiles under study (Supplementary Table  S7 ).

HS-SPME-GC-MS

HS-SPME-GC-MS (Shimadzu GCMS-QP-2010 Ultra) was used to measure additional volatile compounds, mainly comprising terpenoids and esters. Samples were analyzed by HS-SPME using a triphase DVB/Carboxen/PDMS 50/30 μm SPME fiber (Supelco Co., Bellefonte, PA, USA) followed by gas chromatography (Thermo Fisher Scientific Trace 1300 series, USA) coupled to a mass spectrometer (Thermo Fisher Scientific ISQ series MS) equipped with a TriPlus RSH autosampler. 5 ml of degassed beer sample was placed in 20 ml vials containing 1.75 g NaCl (VWR, 27810.295). 5 µl internal standard mix was added, containing 2-heptanol (1 g/L) (Sigma-Aldrich, H3003), 4-fluorobenzaldehyde (1 g/L) (Sigma-Aldrich, 128376), 2,3-hexanedione (1 g/L) (Sigma-Aldrich, 144169) and guaiacol (1 g/L) (Sigma-Aldrich, W253200) in ethanol (Fisher Chemical, E/0650DF/C17). Each sample was incubated at 60 °C in the autosampler oven with constant agitation. After 5 min equilibration, the SPME fiber was exposed to the sample headspace for 30 min. The compounds trapped on the fiber were thermally desorbed in the injection port of the chromatograph by heating the fiber for 15 min at 270 °C.

The GC-MS was equipped with a low polarity RXi-5Sil MS column (length, 20 m; internal diameter, 0.18 mm; layer thickness, 0.18 µm; Restek, Bellefonte, PA, USA). Injection was performed in splitless mode at 320 °C, a split flow of 9 ml/min, a purge flow of 5 ml/min and an open valve time of 3 min. To obtain a pulsed injection, a programmed gas flow was used whereby the helium gas flow was set at 2.7 mL/min for 0.1 min, followed by a decrease in flow of 20 ml/min to the normal 0.9 mL/min. The temperature was first held at 30 °C for 3 min and then allowed to rise to 80 °C at a rate of 7 °C/min, followed by a second ramp of 2 °C/min till 125 °C and a final ramp of 8 °C/min with a final temperature of 270 °C.

Mass acquisition range was 33 to 550 amu at a scan rate of 5 scans/s. Electron impact ionization energy was 70 eV. The interface and ion source were kept at 275 °C and 250 °C, respectively. A mix of linear n-alkanes (from C7 to C40, Supelco Co.) was injected into the GC-MS under identical conditions to serve as external retention index markers. Identification and quantification of the compounds were performed using an in-house developed R script as described in Goelen et al. and Reher et al. 87 , 88 (for package information, see Supplementary Table  S8 ). Briefly, chromatograms were analyzed using AMDIS (v2.71) 89 to separate overlapping peaks and obtain pure compound spectra. The NIST MS Search software (v2.0 g) in combination with the NIST2017, FFNSC3 and Adams4 libraries were used to manually identify the empirical spectra, taking into account the expected retention time. After background subtraction and correcting for retention time shifts between samples run on different days based on alkane ladders, compound elution profiles were extracted and integrated using a file with 284 target compounds of interest, which were either recovered in our identified AMDIS list of spectra or were known to occur in beer. Compound elution profiles were estimated for every peak in every chromatogram over a time-restricted window using weighted non-negative least square analysis after which peak areas were integrated 87 , 88 . Batch effect correction was performed by normalizing against the most stable internal standard compound, 4-fluorobenzaldehyde. Out of all 284 target compounds that were analyzed, 167 were visually judged to have reliable elution profiles and were used for final analysis.

Discrete photometric and enzymatic analysis

Discrete photometric and enzymatic analysis (Thermo Scientific TM Gallery TM Plus Beermaster Discrete Analyzer) was used to measure acetic acid, ammonia, beta-glucan, iso-alpha acids, color, sugars, glycerol, iron, pH, protein, and sulfite. 2 ml of sample volume was used for the analyses. Information regarding the reagents and standard solutions used for analyses and calibrations is included in Supplementary Table  S7 and Supplementary Table  S9 .

NIR analyses

NIR analysis (Anton Paar Alcolyzer Beer ME System) was used to measure ethanol. Measurements comprised 50 ml of sample, and a 10% EtOH solution was used for calibration.

Correlation calculations

Pairwise Spearman Rank correlations were calculated between all chemical properties.

Sensory dataset

Trained panel.

Our trained tasting panel consisted of volunteers who gave prior verbal informed consent. All compounds used for the validation experiment were of food-grade quality. The tasting sessions were approved by the Social and Societal Ethics Committee of the KU Leuven (G-2022-5677-R2(MAR)). All online reviewers agreed to the Terms and Conditions of the RateBeer website.

Sensory analysis was performed according to the American Society of Brewing Chemists (ASBC) Sensory Analysis Methods 90 . 30 volunteers were screened through a series of triangle tests. The sixteen most sensitive and consistent tasters were retained as taste panel members. The resulting panel was diverse in age [22–42, mean: 29], sex [56% male] and nationality [7 different countries]. The panel developed a consensus vocabulary to describe beer aroma, taste and mouthfeel. Panelists were trained to identify and score 50 different attributes, using a 7-point scale to rate attributes’ intensity. The scoring sheet is included as Supplementary Data  3 . Sensory assessments took place between 10–12 a.m. The beers were served in black-colored glasses. Per session, between 5 and 12 beers of the same style were tasted at 12 °C to 16 °C. Two reference beers were added to each set and indicated as ‘Reference 1 & 2’, allowing panel members to calibrate their ratings. Not all panelists were present at every tasting. Scores were scaled by standard deviation and mean-centered per taster. Values are represented as z-scores and clustered by Euclidean distance. Pairwise Spearman correlations were calculated between taste and aroma sensory attributes. Panel consistency was evaluated by repeating samples on different sessions and performing ANOVA to identify differences, using the ‘stats’ package (v4.2.2) in R (for package information, see Supplementary Table  S8 ).

Online reviews from a public database

The ‘scrapy’ package in Python (v3.6) (for package information, see Supplementary Table  S8 ). was used to collect 232,288 online reviews (mean=922, min=6, max=5343) from RateBeer, an online beer review database. Each review entry comprised 5 numerical scores (appearance, aroma, taste, palate and overall quality) and an optional review text. The total number of reviews per reviewer was collected separately. Numerical scores were scaled and centered per rater, and mean scores were calculated per beer.

For the review texts, the language was estimated using the packages ‘langdetect’ and ‘langid’ in Python. Reviews that were classified as English by both packages were kept. Reviewers with fewer than 100 entries overall were discarded. 181,025 reviews from >6000 reviewers from >40 countries remained. Text processing was done using the ‘nltk’ package in Python. Texts were corrected for slang and misspellings; proper nouns and rare words that are relevant to the beer context were specified and kept as-is (‘Chimay’,’Lambic’, etc.). A dictionary of semantically similar sensorial terms, for example ‘floral’ and ‘flower’, was created and collapsed together into one term. Words were stemmed and lemmatized to avoid identifying words such as ‘acid’ and ‘acidity’ as separate terms. Numbers and punctuation were removed.

Sentences from up to 50 randomly chosen reviews per beer were manually categorized according to the aspect of beer they describe (appearance, aroma, taste, palate, overall quality—not to be confused with the 5 numerical scores described above) or flagged as irrelevant if they contained no useful information. If a beer contained fewer than 50 reviews, all reviews were manually classified. This labeled data set was used to train a model that classified the rest of the sentences for all beers 91 . Sentences describing taste and aroma were extracted, and term frequency–inverse document frequency (TFIDF) was implemented to calculate enrichment scores for sensorial words per beer.

The sex of the tasting subject was not considered when building our sensory database. Instead, results from different panelists were averaged, both for our trained panel (56% male, 44% female) and the RateBeer reviews (70% male, 30% female for RateBeer as a whole).

Beer price collection and processing

Beer prices were collected from the following stores: Colruyt, Delhaize, Total Wine, BeerHawk, The Belgian Beer Shop, The Belgian Shop, and Beer of Belgium. Where applicable, prices were converted to Euros and normalized per liter. Spearman correlations were calculated between these prices and mean overall appreciation scores from RateBeer and the taste panel, respectively.

Pairwise Spearman Rank correlations were calculated between all sensory properties.

Machine learning models

Predictive modeling of sensory profiles from chemical data.

Regression models were constructed to predict (a) trained panel scores for beer flavors and quality from beer chemical profiles and (b) public reviews’ appreciation scores from beer chemical profiles. Z-scores were used to represent sensory attributes in both data sets. Chemical properties with log-normal distributions (Shapiro-Wilk test, p  <  0.05 ) were log-transformed. Missing chemical measurements (0.1% of all data) were replaced with mean values per attribute. Observations from 250 beers were randomly separated into a training set (70%, 175 beers) and a test set (30%, 75 beers), stratified per beer style. Chemical measurements (p = 231) were normalized based on the training set average and standard deviation. In total, three linear regression-based models: linear regression with first-order interaction terms (LR), lasso regression with first-order interaction terms (Lasso) and partial least squares regression (PLSR); five decision tree models, Adaboost regressor (ABR), Extra Trees (ET), Gradient Boosting regressor (GBR), Random Forest (RF) and XGBoost regressor (XGBR); one support vector machine model (SVR) and one artificial neural network model (ANN) were trained. The models were implemented using the ‘scikit-learn’ package (v1.2.2) and ‘xgboost’ package (v1.7.3) in Python (v3.9.16). Models were trained, and hyperparameters optimized, using five-fold cross-validated grid search with the coefficient of determination (R 2 ) as the evaluation metric. The ANN (scikit-learn’s MLPRegressor) was optimized using Bayesian Tree-Structured Parzen Estimator optimization with the ‘Optuna’ Python package (v3.2.0). Individual models were trained per attribute, and a multi-output model was trained on all attributes simultaneously.

Model dissection

GBR was found to outperform other methods, resulting in models with the highest average R 2 values in both trained panel and public review data sets. Impurity-based rankings of the most important predictors for each predicted sensorial trait were obtained using the ‘scikit-learn’ package. To observe the relationships between these chemical properties and their predicted targets, partial dependence plots (PDP) were constructed for the six most important predictors of consumer appreciation 74 , 75 .

The ‘SHAP’ package in Python (v0.41.0) was implemented to provide an alternative ranking of predictor importance and to visualize the predictors’ effects as a function of their concentration 68 .

Validation of causal chemical properties

To validate the effects of the most important model features on predicted sensory attributes, beers were spiked with the chemical compounds identified by the models and descriptive sensory analyses were carried out according to the American Society of Brewing Chemists (ASBC) protocol 90 .

Compound spiking was done 30 min before tasting. Compounds were spiked into fresh beer bottles, that were immediately resealed and inverted three times. Fresh bottles of beer were opened for the same duration, resealed, and inverted thrice, to serve as controls. Pairs of spiked samples and controls were served simultaneously, chilled and in dark glasses as outlined in the Trained panel section above. Tasters were instructed to select the glass with the higher flavor intensity for each attribute (directional difference test 92 ) and to select the glass they prefer.

The final concentration after spiking was equal to the within-style average, after normalizing by ethanol concentration. This was done to ensure balanced flavor profiles in the final spiked beer. The same methods were applied to improve a non-alcoholic beer. Compounds were the following: ethyl acetate (Merck KGaA, W241415), ethyl hexanoate (Merck KGaA, W243906), isoamyl acetate (Merck KGaA, W205508), phenethyl acetate (Merck KGaA, W285706), ethanol (96%, Colruyt), glycerol (Merck KGaA, W252506), lactic acid (Merck KGaA, 261106).

Significant differences in preference or perceived intensity were determined by performing the two-sided binomial test on each attribute.

Reporting summary

Further information on research design is available in the  Nature Portfolio Reporting Summary linked to this article.

Data availability

The data that support the findings of this work are available in the Supplementary Data files and have been deposited to Zenodo under accession code 10653704 93 . The RateBeer scores data are under restricted access, they are not publicly available as they are property of RateBeer (ZX Ventures, USA). Access can be obtained from the authors upon reasonable request and with permission of RateBeer (ZX Ventures, USA).  Source data are provided with this paper.

Code availability

The code for training the machine learning models, analyzing the models, and generating the figures has been deposited to Zenodo under accession code 10653704 93 .

Tieman, D. et al. A chemical genetic roadmap to improved tomato flavor. Science 355 , 391–394 (2017).

Article   ADS   CAS   PubMed   Google Scholar  

Plutowska, B. & Wardencki, W. Application of gas chromatography–olfactometry (GC–O) in analysis and quality assessment of alcoholic beverages – A review. Food Chem. 107 , 449–463 (2008).

Article   CAS   Google Scholar  

Legin, A., Rudnitskaya, A., Seleznev, B. & Vlasov, Y. Electronic tongue for quality assessment of ethanol, vodka and eau-de-vie. Anal. Chim. Acta 534 , 129–135 (2005).

Loutfi, A., Coradeschi, S., Mani, G. K., Shankar, P. & Rayappan, J. B. B. Electronic noses for food quality: A review. J. Food Eng. 144 , 103–111 (2015).

Ahn, Y.-Y., Ahnert, S. E., Bagrow, J. P. & Barabási, A.-L. Flavor network and the principles of food pairing. Sci. Rep. 1 , 196 (2011).

Article   CAS   PubMed   PubMed Central   Google Scholar  

Bartoshuk, L. M. & Klee, H. J. Better fruits and vegetables through sensory analysis. Curr. Biol. 23 , R374–R378 (2013).

Article   CAS   PubMed   Google Scholar  

Piggott, J. R. Design questions in sensory and consumer science. Food Qual. Prefer. 3293 , 217–220 (1995).

Article   Google Scholar  

Kermit, M. & Lengard, V. Assessing the performance of a sensory panel-panellist monitoring and tracking. J. Chemom. 19 , 154–161 (2005).

Cook, D. J., Hollowood, T. A., Linforth, R. S. T. & Taylor, A. J. Correlating instrumental measurements of texture and flavour release with human perception. Int. J. Food Sci. Technol. 40 , 631–641 (2005).

Chinchanachokchai, S., Thontirawong, P. & Chinchanachokchai, P. A tale of two recommender systems: The moderating role of consumer expertise on artificial intelligence based product recommendations. J. Retail. Consum. Serv. 61 , 1–12 (2021).

Ross, C. F. Sensory science at the human-machine interface. Trends Food Sci. Technol. 20 , 63–72 (2009).

Chambers, E. IV & Koppel, K. Associations of volatile compounds with sensory aroma and flavor: The complex nature of flavor. Molecules 18 , 4887–4905 (2013).

Pinu, F. R. Metabolomics—The new frontier in food safety and quality research. Food Res. Int. 72 , 80–81 (2015).

Danezis, G. P., Tsagkaris, A. S., Brusic, V. & Georgiou, C. A. Food authentication: state of the art and prospects. Curr. Opin. Food Sci. 10 , 22–31 (2016).

Shepherd, G. M. Smell images and the flavour system in the human brain. Nature 444 , 316–321 (2006).

Meilgaard, M. C. Prediction of flavor differences between beers from their chemical composition. J. Agric. Food Chem. 30 , 1009–1017 (1982).

Xu, L. et al. Widespread receptor-driven modulation in peripheral olfactory coding. Science 368 , eaaz5390 (2020).

Kupferschmidt, K. Following the flavor. Science 340 , 808–809 (2013).

Billesbølle, C. B. et al. Structural basis of odorant recognition by a human odorant receptor. Nature 615 , 742–749 (2023).

Article   ADS   PubMed   PubMed Central   Google Scholar  

Smith, B. Perspective: Complexities of flavour. Nature 486 , S6–S6 (2012).

Pfister, P. et al. Odorant receptor inhibition is fundamental to odor encoding. Curr. Biol. 30 , 2574–2587 (2020).

Moskowitz, H. W., Kumaraiah, V., Sharma, K. N., Jacobs, H. L. & Sharma, S. D. Cross-cultural differences in simple taste preferences. Science 190 , 1217–1218 (1975).

Eriksson, N. et al. A genetic variant near olfactory receptor genes influences cilantro preference. Flavour 1 , 22 (2012).

Ferdenzi, C. et al. Variability of affective responses to odors: Culture, gender, and olfactory knowledge. Chem. Senses 38 , 175–186 (2013).

Article   PubMed   Google Scholar  

Lawless, H. T. & Heymann, H. Sensory evaluation of food: Principles and practices. (Springer, New York, NY). https://doi.org/10.1007/978-1-4419-6488-5 (2010).

Colantonio, V. et al. Metabolomic selection for enhanced fruit flavor. Proc. Natl. Acad. Sci. 119 , e2115865119 (2022).

Fritz, F., Preissner, R. & Banerjee, P. VirtualTaste: a web server for the prediction of organoleptic properties of chemical compounds. Nucleic Acids Res 49 , W679–W684 (2021).

Tuwani, R., Wadhwa, S. & Bagler, G. BitterSweet: Building machine learning models for predicting the bitter and sweet taste of small molecules. Sci. Rep. 9 , 1–13 (2019).

Dagan-Wiener, A. et al. Bitter or not? BitterPredict, a tool for predicting taste from chemical structure. Sci. Rep. 7 , 1–13 (2017).

Pallante, L. et al. Toward a general and interpretable umami taste predictor using a multi-objective machine learning approach. Sci. Rep. 12 , 1–11 (2022).

Malavolta, M. et al. A survey on computational taste predictors. Eur. Food Res. Technol. 248 , 2215–2235 (2022).

Lee, B. K. et al. A principal odor map unifies diverse tasks in olfactory perception. Science 381 , 999–1006 (2023).

Mayhew, E. J. et al. Transport features predict if a molecule is odorous. Proc. Natl. Acad. Sci. 119 , e2116576119 (2022).

Niu, Y. et al. Sensory evaluation of the synergism among ester odorants in light aroma-type liquor by odor threshold, aroma intensity and flash GC electronic nose. Food Res. Int. 113 , 102–114 (2018).

Yu, P., Low, M. Y. & Zhou, W. Design of experiments and regression modelling in food flavour and sensory analysis: A review. Trends Food Sci. Technol. 71 , 202–215 (2018).

Oladokun, O. et al. The impact of hop bitter acid and polyphenol profiles on the perceived bitterness of beer. Food Chem. 205 , 212–220 (2016).

Linforth, R., Cabannes, M., Hewson, L., Yang, N. & Taylor, A. Effect of fat content on flavor delivery during consumption: An in vivo model. J. Agric. Food Chem. 58 , 6905–6911 (2010).

Guo, S., Na Jom, K. & Ge, Y. Influence of roasting condition on flavor profile of sunflower seeds: A flavoromics approach. Sci. Rep. 9 , 11295 (2019).

Ren, Q. et al. The changes of microbial community and flavor compound in the fermentation process of Chinese rice wine using Fagopyrum tataricum grain as feedstock. Sci. Rep. 9 , 3365 (2019).

Hastie, T., Friedman, J. & Tibshirani, R. The Elements of Statistical Learning. (Springer, New York, NY). https://doi.org/10.1007/978-0-387-21606-5 (2001).

Dietz, C., Cook, D., Huismann, M., Wilson, C. & Ford, R. The multisensory perception of hop essential oil: a review. J. Inst. Brew. 126 , 320–342 (2020).

CAS   Google Scholar  

Roncoroni, Miguel & Verstrepen, Kevin Joan. Belgian Beer: Tested and Tasted. (Lannoo, 2018).

Meilgaard, M. Flavor chemistry of beer: Part II: Flavor and threshold of 239 aroma volatiles. in (1975).

Bokulich, N. A. & Bamforth, C. W. The microbiology of malting and brewing. Microbiol. Mol. Biol. Rev. MMBR 77 , 157–172 (2013).

Dzialo, M. C., Park, R., Steensels, J., Lievens, B. & Verstrepen, K. J. Physiology, ecology and industrial applications of aroma formation in yeast. FEMS Microbiol. Rev. 41 , S95–S128 (2017).

Article   PubMed   PubMed Central   Google Scholar  

Datta, A. et al. Computer-aided food engineering. Nat. Food 3 , 894–904 (2022).

American Society of Brewing Chemists. Beer Methods. (American Society of Brewing Chemists, St. Paul, MN, U.S.A.).

Olaniran, A. O., Hiralal, L., Mokoena, M. P. & Pillay, B. Flavour-active volatile compounds in beer: production, regulation and control. J. Inst. Brew. 123 , 13–23 (2017).

Verstrepen, K. J. et al. Flavor-active esters: Adding fruitiness to beer. J. Biosci. Bioeng. 96 , 110–118 (2003).

Meilgaard, M. C. Flavour chemistry of beer. part I: flavour interaction between principal volatiles. Master Brew. Assoc. Am. Tech. Q 12 , 107–117 (1975).

Briggs, D. E., Boulton, C. A., Brookes, P. A. & Stevens, R. Brewing 227–254. (Woodhead Publishing). https://doi.org/10.1533/9781855739062.227 (2004).

Bossaert, S., Crauwels, S., De Rouck, G. & Lievens, B. The power of sour - A review: Old traditions, new opportunities. BrewingScience 72 , 78–88 (2019).

Google Scholar  

Verstrepen, K. J. et al. Flavor active esters: Adding fruitiness to beer. J. Biosci. Bioeng. 96 , 110–118 (2003).

Snauwaert, I. et al. Microbial diversity and metabolite composition of Belgian red-brown acidic ales. Int. J. Food Microbiol. 221 , 1–11 (2016).

Spitaels, F. et al. The microbial diversity of traditional spontaneously fermented lambic beer. PLoS ONE 9 , e95384 (2014).

Blanco, C. A., Andrés-Iglesias, C. & Montero, O. Low-alcohol Beers: Flavor Compounds, Defects, and Improvement Strategies. Crit. Rev. Food Sci. Nutr. 56 , 1379–1388 (2016).

Jackowski, M. & Trusek, A. Non-Alcohol. beer Prod. – Overv. 20 , 32–38 (2018).

Takoi, K. et al. The contribution of geraniol metabolism to the citrus flavour of beer: Synergy of geraniol and β-citronellol under coexistence with excess linalool. J. Inst. Brew. 116 , 251–260 (2010).

Kroeze, J. H. & Bartoshuk, L. M. Bitterness suppression as revealed by split-tongue taste stimulation in humans. Physiol. Behav. 35 , 779–783 (1985).

Mennella, J. A. et al. A spoonful of sugar helps the medicine go down”: Bitter masking bysucrose among children and adults. Chem. Senses 40 , 17–25 (2015).

Wietstock, P., Kunz, T., Perreira, F. & Methner, F.-J. Metal chelation behavior of hop acids in buffered model systems. BrewingScience 69 , 56–63 (2016).

Sancho, D., Blanco, C. A., Caballero, I. & Pascual, A. Free iron in pale, dark and alcohol-free commercial lager beers. J. Sci. Food Agric. 91 , 1142–1147 (2011).

Rodrigues, H. & Parr, W. V. Contribution of cross-cultural studies to understanding wine appreciation: A review. Food Res. Int. 115 , 251–258 (2019).

Korneva, E. & Blockeel, H. Towards better evaluation of multi-target regression models. in ECML PKDD 2020 Workshops (eds. Koprinska, I. et al.) 353–362 (Springer International Publishing, Cham, 2020). https://doi.org/10.1007/978-3-030-65965-3_23 .

Gastón Ares. Mathematical and Statistical Methods in Food Science and Technology. (Wiley, 2013).

Grinsztajn, L., Oyallon, E. & Varoquaux, G. Why do tree-based models still outperform deep learning on tabular data? Preprint at http://arxiv.org/abs/2207.08815 (2022).

Gries, S. T. Statistics for Linguistics with R: A Practical Introduction. in Statistics for Linguistics with R (De Gruyter Mouton, 2021). https://doi.org/10.1515/9783110718256 .

Lundberg, S. M. et al. From local explanations to global understanding with explainable AI for trees. Nat. Mach. Intell. 2 , 56–67 (2020).

Ickes, C. M. & Cadwallader, K. R. Effects of ethanol on flavor perception in alcoholic beverages. Chemosens. Percept. 10 , 119–134 (2017).

Kato, M. et al. Influence of high molecular weight polypeptides on the mouthfeel of commercial beer. J. Inst. Brew. 127 , 27–40 (2021).

Wauters, R. et al. Novel Saccharomyces cerevisiae variants slow down the accumulation of staling aldehydes and improve beer shelf-life. Food Chem. 398 , 1–11 (2023).

Li, H., Jia, S. & Zhang, W. Rapid determination of low-level sulfur compounds in beer by headspace gas chromatography with a pulsed flame photometric detector. J. Am. Soc. Brew. Chem. 66 , 188–191 (2008).

Dercksen, A., Laurens, J., Torline, P., Axcell, B. C. & Rohwer, E. Quantitative analysis of volatile sulfur compounds in beer using a membrane extraction interface. J. Am. Soc. Brew. Chem. 54 , 228–233 (1996).

Molnar, C. Interpretable Machine Learning: A Guide for Making Black-Box Models Interpretable. (2020).

Zhao, Q. & Hastie, T. Causal interpretations of black-box models. J. Bus. Econ. Stat. Publ. Am. Stat. Assoc. 39 , 272–281 (2019).

Article   MathSciNet   Google Scholar  

Hastie, T., Tibshirani, R. & Friedman, J. The Elements of Statistical Learning. (Springer, 2019).

Labrado, D. et al. Identification by NMR of key compounds present in beer distillates and residual phases after dealcoholization by vacuum distillation. J. Sci. Food Agric. 100 , 3971–3978 (2020).

Lusk, L. T., Kay, S. B., Porubcan, A. & Ryder, D. S. Key olfactory cues for beer oxidation. J. Am. Soc. Brew. Chem. 70 , 257–261 (2012).

Gonzalez Viejo, C., Torrico, D. D., Dunshea, F. R. & Fuentes, S. Development of artificial neural network models to assess beer acceptability based on sensory properties using a robotic pourer: A comparative model approach to achieve an artificial intelligence system. Beverages 5 , 33 (2019).

Gonzalez Viejo, C., Fuentes, S., Torrico, D. D., Godbole, A. & Dunshea, F. R. Chemical characterization of aromas in beer and their effect on consumers liking. Food Chem. 293 , 479–485 (2019).

Gilbert, J. L. et al. Identifying breeding priorities for blueberry flavor using biochemical, sensory, and genotype by environment analyses. PLOS ONE 10 , 1–21 (2015).

Goulet, C. et al. Role of an esterase in flavor volatile variation within the tomato clade. Proc. Natl. Acad. Sci. 109 , 19009–19014 (2012).

Article   ADS   CAS   PubMed   PubMed Central   Google Scholar  

Borisov, V. et al. Deep Neural Networks and Tabular Data: A Survey. IEEE Trans. Neural Netw. Learn. Syst. 1–21 https://doi.org/10.1109/TNNLS.2022.3229161 (2022).

Statista. Statista Consumer Market Outlook: Beer - Worldwide.

Seitz, H. K. & Stickel, F. Molecular mechanisms of alcoholmediated carcinogenesis. Nat. Rev. Cancer 7 , 599–612 (2007).

Voordeckers, K. et al. Ethanol exposure increases mutation rate through error-prone polymerases. Nat. Commun. 11 , 3664 (2020).

Goelen, T. et al. Bacterial phylogeny predicts volatile organic compound composition and olfactory response of an aphid parasitoid. Oikos 129 , 1415–1428 (2020).

Article   ADS   Google Scholar  

Reher, T. et al. Evaluation of hop (Humulus lupulus) as a repellent for the management of Drosophila suzukii. Crop Prot. 124 , 104839 (2019).

Stein, S. E. An integrated method for spectrum extraction and compound identification from gas chromatography/mass spectrometry data. J. Am. Soc. Mass Spectrom. 10 , 770–781 (1999).

American Society of Brewing Chemists. Sensory Analysis Methods. (American Society of Brewing Chemists, St. Paul, MN, U.S.A., 1992).

McAuley, J., Leskovec, J. & Jurafsky, D. Learning Attitudes and Attributes from Multi-Aspect Reviews. Preprint at https://doi.org/10.48550/arXiv.1210.3926 (2012).

Meilgaard, M. C., Carr, B. T. & Carr, B. T. Sensory Evaluation Techniques. (CRC Press, Boca Raton). https://doi.org/10.1201/b16452 (2014).

Schreurs, M. et al. Data from: Predicting and improving complex beer flavor through machine learning. Zenodo https://doi.org/10.5281/zenodo.10653704 (2024).

Download references

Acknowledgements

We thank all lab members for their discussions and thank all tasting panel members for their contributions. Special thanks go out to Dr. Karin Voordeckers for her tremendous help in proofreading and improving the manuscript. M.S. was supported by a Baillet-Latour fellowship, L.C. acknowledges financial support from KU Leuven (C16/17/006), F.A.T. was supported by a PhD fellowship from FWO (1S08821N). Research in the lab of K.J.V. is supported by KU Leuven, FWO, VIB, VLAIO and the Brewing Science Serves Health Fund. Research in the lab of T.W. is supported by FWO (G.0A51.15) and KU Leuven (C16/17/006).

Author information

These authors contributed equally: Michiel Schreurs, Supinya Piampongsant, Miguel Roncoroni.

Authors and Affiliations

VIB—KU Leuven Center for Microbiology, Gaston Geenslaan 1, B-3001, Leuven, Belgium

Michiel Schreurs, Supinya Piampongsant, Miguel Roncoroni, Lloyd Cool, Beatriz Herrera-Malaver, Florian A. Theßeling & Kevin J. Verstrepen

CMPG Laboratory of Genetics and Genomics, KU Leuven, Gaston Geenslaan 1, B-3001, Leuven, Belgium

Leuven Institute for Beer Research (LIBR), Gaston Geenslaan 1, B-3001, Leuven, Belgium

Laboratory of Socioecology and Social Evolution, KU Leuven, Naamsestraat 59, B-3000, Leuven, Belgium

Lloyd Cool, Christophe Vanderaa & Tom Wenseleers

VIB Bioinformatics Core, VIB, Rijvisschestraat 120, B-9052, Ghent, Belgium

Łukasz Kreft & Alexander Botzki

AB InBev SA/NV, Brouwerijplein 1, B-3000, Leuven, Belgium

Philippe Malcorps & Luk Daenen

You can also search for this author in PubMed   Google Scholar

Contributions

S.P., M.S. and K.J.V. conceived the experiments. S.P., M.S. and K.J.V. designed the experiments. S.P., M.S., M.R., B.H. and F.A.T. performed the experiments. S.P., M.S., L.C., C.V., L.K., A.B., P.M., L.D., T.W. and K.J.V. contributed analysis ideas. S.P., M.S., L.C., C.V., T.W. and K.J.V. analyzed the data. All authors contributed to writing the manuscript.

Corresponding author

Correspondence to Kevin J. Verstrepen .

Ethics declarations

Competing interests.

K.J.V. is affiliated with bar.on. The other authors declare no competing interests.

Peer review

Peer review information.

Nature Communications thanks Florian Bauer, Andrew John Macintosh and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. A peer review file is available.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary information, peer review file, description of additional supplementary files, supplementary data 1, supplementary data 2, supplementary data 3, supplementary data 4, supplementary data 5, supplementary data 6, supplementary data 7, reporting summary, source data, source data, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Schreurs, M., Piampongsant, S., Roncoroni, M. et al. Predicting and improving complex beer flavor through machine learning. Nat Commun 15 , 2368 (2024). https://doi.org/10.1038/s41467-024-46346-0

Download citation

Received : 30 October 2023

Accepted : 21 February 2024

Published : 26 March 2024

DOI : https://doi.org/10.1038/s41467-024-46346-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

By submitting a comment you agree to abide by our Terms and Community Guidelines . If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

Sign up for the Nature Briefing: Translational Research newsletter — top stories in biotechnology, drug discovery and pharma.

research in development pdf

Help | Advanced Search

Computer Science > Operating Systems

Title: aios: llm agent operating system.

Abstract: The integration and deployment of large language model (LLM)-based intelligent agents have been fraught with challenges that compromise their efficiency and efficacy. Among these issues are sub-optimal scheduling and resource allocation of agent requests over the LLM, the difficulties in maintaining context during interactions between agent and LLM, and the complexities inherent in integrating heterogeneous agents with different capabilities and specializations. The rapid increase of agent quantity and complexity further exacerbates these issues, often leading to bottlenecks and sub-optimal utilization of resources. Inspired by these challenges, this paper presents AIOS, an LLM agent operating system, which embeds large language model into operating systems (OS) as the brain of the OS, enabling an operating system "with soul" -- an important step towards AGI. Specifically, AIOS is designed to optimize resource allocation, facilitate context switch across agents, enable concurrent execution of agents, provide tool service for agents, and maintain access control for agents. We present the architecture of such an operating system, outline the core challenges it aims to resolve, and provide the basic design and implementation of the AIOS. Our experiments on concurrent execution of multiple agents demonstrate the reliability and efficiency of our AIOS modules. Through this, we aim to not only improve the performance and efficiency of LLM agents but also to pioneer for better development and deployment of the AIOS ecosystem in the future. The project is open-source at this https URL .

Submission history

Access paper:.

  • HTML (experimental)
  • Other Formats

References & Citations

  • Google Scholar
  • Semantic Scholar

BibTeX formatted citation

BibSonomy logo

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

  • Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

IMAGES

  1. (PDF) Theories of Development

    research in development pdf

  2. PDF

    research in development pdf

  3. ⭐ Types of research paper pdf. Research Paper Structure. 2022-10-14

    research in development pdf

  4. (PDF) Developmental Research

    research in development pdf

  5. (PDF) Researching academic development

    research in development pdf

  6. (PDF) Uneven Growth: A Framework for Research in Development Economics

    research in development pdf

VIDEO

  1. eCornell Online Certificates

  2. ECONOMIC DEVELOPMENT

  3. Introduction to the Research Process PART 3

  4. @om bio study zone|| development of chick||by-R.k sir||PGT, TGT, NEET, NCERT, ZOOLOGY ||BPSC ||

  5. PDF EXTRA PRO MT MANAGER

  6. Concept of Growth and development |For M.Ed (Psychology of Learning and development)|By Anil Kashyap

COMMENTS

  1. PDF A GUIDE TO RESEARCH DEVELOPMENT

    As a research institution, this investment is most often in man-hours spent. developing the initial research proposal. In 2018, the United States government spent $142.9 billion funding research and. development activities.1 This funding makes up only a portion of the overall research.

  2. PDF INTRODUCTION: WHY DEVELOPMENT RESEARCH MATTERS

    The book is written for development workers, and is intended to give you the tools to use research as effectively as possible in your work. We draw on examples from international development work and from work in the UK to improve the wellbeing of disadvantaged communities.

  3. PDF Research and Development

    Research and Development. Research and Development (R&D) is the term commonly used to describe the activities. undertaken by firms and other entities such as individual entrepreneurs in order to create new or. improved products and processes. The broadest meaning of the term covers activities from basic.

  4. (PDF) Research and Development: One of the Needs of the World Today is

    Research and Development: One of the Needs of the World Today is Research and Development. Publisher: LAP LAMBERT Academic Publishing. ISBN: 978-613-7-84142-6.

  5. MANAGING RESEARCH, DEVELOPMENT, AND INNOVATION

    17 Research, Development, and Science Policy 331 17.1 Relationship Between Science and Technology, 334 17.2 Technical Innovation and Economic Development, 336 17.3 Analysis of Investment in Basic Research, 339 17.4 R&D Expenditure, 340 17.5 R&D Productivity, 347 17.6 Global Perspectives on Innovation, 352 17.7 R&D Expenditure and Science Policy ...

  6. PDF Definitions of Research and Development: An Annotated Compilation of

    Definition: Conduct of research and development (R&D): Research and experimental development activities are defined as creative and systematic work undertaken in order to increase the stock of knowledge—including knowledge of people, culture, and society—and to devise new applications using available knowledge.

  7. PDF Common Guidelines for Education Research and Development

    Research contribute Type seek to test, to improved. #1: Foundational of systems or learning processes. Research. in methodologies and/o technologies of teaching provides or education the fundamental that will influence and infor outcomes. and may knowledge development in contexts. research and innovations of.

  8. PDF The Principles of 1 Developmental Psychology

    the research agendas in developmental psychology is to understand the nature and the limits of plasticity in various domains of functioning. The sixth principle states that development is also situated in contexts and in history. Development varies across the different contexts in which we live our lives. For

  9. (PDF) Research and Development: A Review of Literature

    Research and Development (R&D) is defined as any systematic. and creative work undertaken in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use ...

  10. Research and Development (R&D)

    Definition. Research and development (R&D) is a broad category describing the entity of basic research, applied research, and development activities. In general research and development means systematic activities in order to increase knowledge and use of this knowledge when developing new products, processes, or services.

  11. PDF Concepts and definitions for identifying R&D

    for interpreting r&d data as part of the development, implementation and evaluation of policy. however, users should note that the focus of this chapter is on definitions for measurement purposes. 2.2. Definition of research and experimental development (R&D) 2.5 Research and experimental development (R&D) comprise creative

  12. (PDF) Research and Development

    Nobelius studied the evolution of management practices relating to research and. development ("R&D") processes and suggested that through 2002 it wa s possible t o. identify the following ...

  13. An Overview of Research and Development in Academia

    Research and development (R&D) have been variously defined individually and in their conjoined form. For example, the Organization for Economic Co-operation and Development (OECD) refers to any creative systematic activity undertaken to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this knowledge to devise new applications [].

  14. PDF U.S. Research and Development Funding and Performance: Fact Sheet

    was for applied research, and $460.5 billion (65.1%) was for development.8 Table 1 shows total U.S. R&D expenditures in 2020 by funding sector and character of work. Notably, federal R&D funding accounts for the largest share of basic research (40.7%) while business accounts for the largest shares of applied research (55.0%) and development (85 ...

  15. PDF Research or Development? A Short History of Research and Development as

    support for public funding of research activity. Research or Development . In 1965, in an article titled The ABC of R&D, David Novick from the RAND Corporation suggested, "We should stop talking about research and development as though they were an entity and examine research on its own and development as a separate and distinct activity".

  16. PDF National Strategic Overview for Research and Development Infrastructure

    for research and development infrastructure . a report by the . subcommittee on research and development infrastructure . committee on science and technology enterprise . of the .

  17. PDF Insights into the Role of Research and Development in Teaching Schools

    Research and development, or R&D, forms one of teaching schools' six core areas of responsibility. The others are: school-led initial teacher training; continuing professional development; supporting other schools; identifying and developing leadership

  18. PDF Developing Your Research Idea

    The The first first step step in in the the process process involves involves developing developing a a research research idea. idea. It It is is. a little little paradoxical, paradoxical, but but coming coming up up with with a a research research idea idea is is both both easy easy and and difficult. difficult.

  19. PDF Research Methodology: Tools and Techniques

    (iii) Research emphasizes the development of generalizations, principles, or theories that will be helpful in predicting future occurrences. (iv) Research is based upon observable experience or empirical evidences. (v) Research demands accurate observation and description. (vi) Research involves gathering new data from primary or first-hand ...

  20. An Introduction to Research and Development (R&D)

    Research and development (R&D) refers to two intertwined processes of research (to identify new knowledge and ideas) and development (turning the ideas into tangible products or processes). Companies undertake R&D in order to develop new products, services, or procedures that will help them grow and expand their operations.

  21. PDF Researcher Development Framework

    Recognises the value of alternative research paradigms and is able to work in, and support others working in, an inter-disciplinary way. Creates new models and hypotheses, research designs, data collection and analysis techniques. Sets expectations for application of methods locally, nationally and internationally. A1.

  22. Handbook: Research and development

    As businesses look for new ways to innovate and finance their R&D activities, application questions continue to emerge. Our objective with this publication is to help you make the judgments associated with these application issues. We start with the basics of R&D accounting and expand to provide insights, examples and perspectives based on our ...

  23. (Pdf) What Is Research Development?

    communicating with a broad au dience: Research Development is a function that seeks to grow. research or increas e the research rep utation of an i nstitution. The authors find this description. 1 ...

  24. Scientific guidelines

    The Agency strongly encourages applicants and marketing authorisation holders to follow these guidelines. Applicants need to justify deviations from guidelines fully in their applications at the time of submission. Before that, they should seek scientific advice, to discuss any proposed deviations during medicine development.. The guidelines are complementary to European Pharmacopoeia ...

  25. Predicting and improving complex beer flavor through machine ...

    Download PDF. Article; Open access; ... counterfeit detection, spoilage detection, and the development of new products and product ... To our knowledge, no previous research gathered data at this ...

  26. QbD Approach to Process Characterization and Quantitative Criticality

    The quality-by-design (QbD) approach is widely utilized for developing and validating manufacturing processes for drug substances as well as drug products. This paper discusses the application of the risk-based QbD approach used at F. Hoffmann-La Roche Ltd. for development, optimization, and characterization of drug substance manufacturing processes for small molecules. It presents the ...

  27. PDF Awards from Federal, Massachusetts, or Municipal Entities for Calendar

    2 2o 2024 Brun, Yuriy DEFENSE ADV RESEARCH PROJECTS AGENCY Formal Methods Proof Synthesis using Large Language Models 2 2p 2024 Paredes, Cliff A MA OFFICE OF INTERNATIONAL TRADE Training for state STEP award provided by the Mass Export Center for FY24 Russell, Thomas P U.S. ARMY RESEARCH OFFICE Adaptive Assemblies of Soft Matter at Interfaces

  28. [2403.16971] AIOS: LLM Agent Operating System

    View PDF HTML (experimental) Abstract: The integration and deployment of large language model (LLM)-based intelligent agents have been fraught with challenges that compromise their efficiency and efficacy. Among these issues are sub-optimal scheduling and resource allocation of agent requests over the LLM, the difficulties in maintaining context during interactions between agent and LLM, and ...

  29. (PDF) Theories of Development

    Abstract. Development is a process of disproportionate growth of systems. In economics, development is a multidimensional process that generates economic, technological, social and institutional ...

  30. PDF Office of the Assistant Secretary for Policy Development and Research

    Erin K. Browne - Director. PD&R Field Economist Organizational Chart. Housing Finance Analysis Division (HFAD) Adam N. Hoffberg - Director. Housing and Demographic Analysis Division (HDAD) George R. Carter III - Director. Public Finance and Regulatory Analysis Division (PFRAD) Alastair McFarlane - Director.