News

Read the full story here. [https://news.byu.edu/intellect/byu-animation-adlab-students-win-student-emmys]

As we enter the fourth installment in the Kung Fu Panda franchise, Po is faced with a new challenge of growth, his promotion to the spiritual leader of the Valley of Peace. We accompany Po as he visits both familiar and new locales where he meets new friends and a dangerous villain. But in order to become the spiritual leader, he must understand what it means to have the balance of Yin and Yang. This seminar will explore how the filmmakers kept balance at the forefront of their design and technology decisions; landscape and architecture reflecting opposite emotions, the use of real time game engines to build out and discover new worlds, the innovative new FX techniques for transforming animated characters, the various threads of the story - good vs evil, familiar vs new, heart vs action.

New tools of artificial intelligence and machine learning allow data scientists to move beyond charts and graphs when trying to harvest insight from data. In this talk, I will discuss how language models like ChatGPT can be used as a serious tool for data analysis, allowing researchers and scientists to perform a variety of analysis on unstructured text. Language models can also be combined with embeddings to provide powerful new ways of thinking about how to cluster and abstract data. Throughout the talk, I will discuss these tools in the context of my current research, involving applications in psychology and political science.

The ubiquity of social media platforms has revolutionized the way information is disseminated during crises. From natural disasters to public health emergencies, individuals turn to platforms like Twitter (now X), Facebook, Reddit, Instagram, and others to share real-time updates, seek assistance, and provide situational awareness. This flood of user-generated content presents both opportunities and challenges for emergency management. This presentation draws upon a blend of case studies and empirical research, including insights gleaned from my own work, to explore ways in which social media data analytics, geospatial mapping, natural language processing, and machine learning techniques can be leveraged to extract actionable insights from the vast volume of online information. Furthermore, I will discuss recent research aimed at mitigating challenges related to misinformation, aggregating data from multimodal sources, and enhancing machine classifier training through sustainable context-sensitive labeling methods in the disaster setting. Through interdisciplinary collaboration and innovative socio-technological solutions, I will demonstrate how we can harness the power of digital platforms to save lives, mitigate suffering, and foster disaster resilience in an increasingly interconnected world.

Abstract: Multi-fidelity learning involves using training examples at different fidelities or resolutions. High-fidelity examples are of high-quality but often are much more costly to collect than inaccurate, low-fidelity examples. How to retrieve and leverage examples at multiple fidelities is the key to reduce the learning cost while maximizing the efficiency. This talk will introduce our recent work in multi-fidelity learning and active learning for scientific machine learning. Physical simulation is a central task in science and engineering domains. However, traditional numerical methods are known to be computationally costly and lack generalizability across different problems. Learning data-driven surrogate models presents a promising strategy for cost reduction. I will discuss three multi-fidelity, multi-resolution active learning approaches designed to dynamically acquire simulation examples and their fidelities, enhancing surrogate learning performance while minimizing data acquisition costs. I will demonstrate the efficacy of these methods through applications in standard benchmarks of physical simulation and topology structure optimization. Furthermore, I will introduce an infinite fidelity surrogate learning framework, which extends the traditional finite fidelity space to an infinite continuous space. This framework offers exciting possibilities for advancing scientific machine learning by enabling more comprehensive representations of complex systems and phenomena.

Come watch three graduate students present on their papers!

After seeing so much progress in AI over the last few years, it’s hard to understand why many enterprises still struggle to bring AI models into production. This research investigates the fundamental drivers of AI system development to identify roadblocks and potential solutions. To address these issues, the relatively new field of Machine Learning Operations, or MLOps, seeks to improve AI development across the entire lifecycle. These improvements promise a shorter time to market, lower costs, and higher value. Leveraging enhanced AI development processes, we explore the possibilities of scaling AI systems to support millions of models in production. At this scale, typical model metrics are no longer sufficient, and new analysis methods are needed. We present a framework for characterizing Ultra-Scale systems and discuss potential approaches for research and analysis. These Ultra-Scale systems could enable novel applications across diverse areas such as manufacturing, demand forecasting, social networks, IoT systems, traffic management, and swarm intelligence.

Abstract: Actions in many real-world domains cannot be executed exactly. An agent’s performance in these domains is influenced by two critical factors: the ability to select effective actions (decision-making skill), and how precisely they can execute those selected actions (execution skill). For an AI to make effective action recommendations to a person, knowledge of their execution skill is required. This talk addresses the problem of estimating both the execution and decision-making skill of an agent, given observations. Several execution skill estimation methods will be presented, each of which utilize different information from the observations and make assumptions about the agent’s decision-making ability. A final novel method forgoes these assumptions about decision-making and instead estimates the execution and decision-making skills simultaneously under a single Bayesian framework. Experimental results in several domains evaluate the estimation accuracy of the estimators, especially focusing on how robust they are as agents and their decision-making methods are varied. These results demonstrate that reasoning about both types of skill together significantly improves the robustness and accuracy of execution skill estimation. A case study using the proposed methods to estimate the skill of Major League Baseball pitchers is presented, along with a complete AI system that utilizes this estimate to provide pitch recommendations. This case study demonstrates how these skill estimation methods can be applied to real-world data sources and provide effective action recommendations to humans.

Abstract: Interactive computational devices, such as smartphones, motion trackers, and smartwatches, are integral to many human activities, including amateur sports and outdoor recreation. Sports and recreation are critical components of human wellness. However, the relationship between interactive computing and the wellness benefits of sports and recreation is not well understood. In this talk, I will present both research results and grand challenges related to the use of interactive computing in sports and recreation. Research results include an interview study on the use of motion data for figure skating coaching and a survey study on the use and non-use of headphones during hiking. Grand challenges involve understanding the athlete as a multi-faceted individual and designing for engagement in nature recreation.

Abstract: Many are asking will Generative AI and Large Language Models (LLMs) put programmers out of business? Will it displace my research and make it irrelevant? This talk provides a fresh perspective on how Generative AI is helping with the 9 hardest things programmers have to do, and our crucial role as computing researchers in this new era. We first present upcoming services in leading IDEs that enable developers to use Generative AI to (i) explain code, bug fixes, summarize recent changes, (ii) generate documentation, commit messages, name suggestions, etc. A top concern remains the trustworthiness of the solutions provided by Generative AI. While many solutions resemble the ones produced by expert developers, LLMs are known to produce hallucinations, i.e., solutions that seem plausible at first, but are deeply flawed. To help software developers trust LLM solutions, we developed novel research that synergistically combines the creative potential of LLMs with the safety of static and dynamic analysis from program transformation systems. Our current results show that our approach is effective: it safely automates code changes and is 14x more effective than previous state of the art that relies solely on static analysis. Moreover, our approach produces results that expert developers trust: we submitted patches generated by our LLM-powered tools to famous open-source projects whose developers accepted most of our contributions. This shows the usefulness of our novel approach and ushers us into a new era when LLMs become effective AI assistants for developers. We hope to inspire you with ideas on how LLMs can help you and your research go even further.

Abstract: AI in the digital domain (i.e, text and images) is progressing at a dizzying pace, in large part due to an abundance of data and an increasing reliance on a larger compute budget. However, AI in the physical domain significantly lags behind. In fields such as engineering, healthcare, robotics, or economics data tends to be scarce, difficult to label, or challenging to aggregate due to privacy concerns. Moreover, while digital AI systems can make mistakes without real-world consequences, an error made by a physical AI system can cause harm, death, or financial loss. In this talk, I discuss strategies for improving the performance and robustness of physical AI systems. I present techniques for solving difficult physical perceptual tasks, ideas for addressing the small data problem, and methods for constructing agents that can perform reliably when the cost of an error is high. Additionally, I discuss successful deployments of these systems across a variety of fields, and present ideas to make physical AI systems more robust in the future.

Abstract: This talk explores classes of individuals who are commonly vulnerable in context of technology use. I will discuss unique considerations that technologists must take into account in order to avoid inadvertently introducing harm to already vulnerable populations. Beyond avoiding harm, I will also discuss opportunities to do good and lift these individuals through technology design. I will also touch on common biases in reporting and analysis, best practices for studying these populations, and explore how to design technologies to be inclusive.

Application of computer science algorithms to the life sciences can substantially improve analysis and interpretation of biological data. This talk explores improvements in sequence alignment algorithms applied to the analysis of CRISPR genome editing—a cutting-edge DNA-editing technology that was recently approved in the UK as a permanent treatment for sickle cell disease. By modifying sequence alignment algorithms to reflect the biological mechanisms of CRISPR systems, we improved accuracy in identifying DNA sequence changes arising from CRISPR genome editing. These improvements are implemented in the software CRISPResso2, a widely-used tool for analysis of genome editing. We have also developed methods to analyze DNA sequences from single cells, and have used these tools to model disease initiation by introducing specific mutations into healthy cells. This talk will demonstrate how sequence alignment algorithms can be applied to cutting-edge biological technologies to improve analysis and interpretation, and ultimately affect human health.

Sound gradual types strengthen code with formal guarantees, but may require expensive run-time checks depending on how typed and untyped code interact. In this paper, we explore profile-guided strategies to discover gradual codebases that run as quickly as untyped code. One strategy rises to the top, but it succeeds in only 50% of all trials. Going forward, we need better profilers to measure type costs. Our experiment was made possible by the Rational Programmer method for automatically testing hypotheses about human programmers.

The ICPC World Finals are scheduled to take place in Luxor, Egypt on April 18, 2024.

Details on this weeks Graduate Seminar Series:

Paco is Research Scientist Manager supporting translation teams in Meta AI (FAIR). He works in the field of machine translation with the aim to break language barriers. He joined Meta in 2016 and has co-led several initiatives (e.g. SeamlessM4T, NLLB , FLORES). His research has been published in top-tier NLP venues like ACL, EMNLP. He was the co-chair of the Research director at AMTA (2020-2022) and Ethics co-chair at EMNLP 2023. He has organized several research competitions focused on low-resource translation and data filtering. Paco obtained his PhD from the ITESM in Mexico, was a visiting scholar at the LTI-CMU from 2008-2009 and participated in DARPA’s GALE evaluation program. Paco was a post-doc and scientist at Qatar Computing Research Institute in Qatar in 2012-2016

The Computer Science department will be offering a new B.S. degree in Machine Learning starting in Fall 2023. This degree is based on the previous emphasis in Data Science, but now has a stronger focus on machine learning.

Intro to neural networks, decision trees, and more - with real life applications!

Convolutional Networks - Bridging the gap between standard and specialized

Join us in congratulating these amazing students!

PhD Dissertation Defense for Aadesh Neupane

Check out the News tab to see other cool stories!

Check out the News tab to see other cool stories!

MS Thesis Defense/PhD Qualifying Process for Jonathan Demke

Check out the News tab to see other cool stories!

Stay tuned for future events on the CS Instagram page: @byucomputsci

CS Professor and team from Idaho State are AI Song Finalists!

The NAC (North American Championship) this last weekend was to determine which teams would advance to the world finals.

Erin Rowan is the Department Secretary in Computer Science. She handles financials, supports faculty recruiting, and trains part-time staff and students.