My primary research interests lie in the areas of natural language processing (NLP) and machine learning (ML). The ultimate goal is to build general intelligent machines that can understand, interact, and help human beings on a wide variety of tasks with trustworthiness and efficiency. I am glad to see LLMs are bringing us one step closer 🤔

In the pre-LLM era, I was a trained NLP researcher with background and expertise in...

In the pre-LLM era, I was a trained NLP researcher with background and expertise in, for example, generative models with Transformers, decoding algorithms and trustworthy generation with different resources. I have worked on a wide range of core NLP tasks and methodologies such as sequence to sequence techniques for text generations (automatic summarization, neural machine translation, etc.) and sequence to graph generations (semantic parsing, program generation, etc.) for semantic understanding. My thesis was on Generating Semantic Graphs for Natural Language.

Nowadays, my research centers around broad language applications and generative AI, where language includes natural language but can also be considered as any sequential information such as code, serialized visual representations, embodied actions, etc. I am motivated to better understand and improve state-of-the-art deep learning models such as (large) language models (LLMs) and multimodal models, on a variety of aspects such as efficiency, knowledge representation and memorization, factualness, security, fair evaluation, reasoning and planning. Some of the topics could be:

  • Retrieval augmentation
  • Knowledge manipulation
  • Reliable generation
  • Code, structured generation, neuro-symbolic AI
  • Long context
  • Information compression
  • Complex reasoning
  • Inference efficiency
  • Multimodal AI (w/ generation, evaluation, training, and novel applications)
  • Etc.

Please reach out to collaborate 😃 I would also love to collaborate on data-driven interdisciplinary applications, such as applying core NLP/ML techniques in many problems such as in science, sociology, and engineering.