March 27-29, 2023

AAAI - EDGeS

Hyatt Regency San Francisco Airport, Burlingame, CA

AAAI-EDGeS 2023 is part of the AAAI Spring Symposium Series

 

A Symposium on Challenges and Methods for Assessing the Next Generation of AI

 

The field of Artificial Intelligence is generally described in three waves. The first wave comprised hand-crafted knowledge for reasoning, with limitations in perception and learning. The second wave has been propelled by significant advances in data-driven methods using machine learning, primarily with deep neural networks, with limitations in reasoning. The third wave of AI combines reasoning machine learning systems into foundation models. With the advent of large domain-universal models (sometimes called ‘foundation models’), we are witnessing a trend towards AI systems that are no longer specific to particular tasks. We are also seeing a resurgence of reasoning and symbolic systems in AI to assist in common sense reasoning, explainable AI, and learning with limited training data. Assessing the next generation of AI will require novel tools, methods, and benchmarks that address both reasoning and generalist systems, individually and combined holistically.


Generalist systems can encompass language models, multimodal models, and various other

developments, such as life-long learning systems. This new generation of increasingly general AI systems can be applied with small or no modifications over a wide range of tasks and applications, in many cases without having been explicitly designed for them. Where current AI systems are typically evaluated against a small set of narrow, task-specific benchmarks, this next generation of AI systems may fall short of reaching or surpassing the state of the art in any one domain, but excel in practical applications due their generality, or various factors that become only visible in the aggregate of many measures.


Modern reasoning systems can encompass neuro-symbolic reasoning, common sense reasoning, and statistical and relational AI (STAR AI). They are combined with data-driven or statistical approaches. Whereas numerous metrics exist for the evaluation of specialized machine learning algorithms, the space of quantifiable metrics for modern reasoning AI systems is limited.


Assessments and benchmarking of these general AI systems will require novel approaches, to allow comparisons of performance of these systems, identify areas in need of research, and shape the direction of progress. Comparing general AI systems may require mapping their performance and properties into a high dimensional space of capabilities, and compare the regions they occupy in that space. Assessing modern reasoning systems may involve comparing the effects of different symbolic representations on the overall performance of the system and also identifying and understanding of vulnerabilities stemming from symbolic design choices.

Goals of the Symposium

  Topics

In the interest of fostering discussion of methodologies for understanding and assessing AI in the domains of reasoning and generativity, we are accepting submissions on topics including (not exhaustive): 

Format

The Symposium will consist of a set of short presentations, grouped into thematic sessions, combined with discussion, over the duration of 2.5 days.

Important Dates

Publication of accepted submissions

Those authors who would like their submission to be part of the published proceedings should submit their camera-ready papers on OpenReview: https://openreview.net/group?id=AAAI.org/2023/Spring_Symposium_Series/EDGeS 

Submissions

You are invited to submit:

Manuscripts must be submitted as PDF files via EasyChair online submission system.

Please keep your paper format in line with AAAI Formatting Instructions (two-column format). The AAAI author kit can be downloaded from: https://www.aaai.org/Publications/Templates/AuthorKit22.zip .

Papers will be peer-reviewed by the Organizing Committee (2-3 reviewers per paper).

EasyChair submission link: https://easychair.org/conferences/?conf=sss23 

At least one of the authors will have to register and present their contribution at the Symposium.


Please send any questions about submissions to aaai.edges@gmail.com

Organizing Committee

For any inquiries, please contact aaai.edges@gmail.com