~/aixsci
200 records · all checked

structural-biology/ai produced the result/PLoS Computational Biology 2024 · v2

Two protein design models redesigned T cell receptor contact points on solved structures

Researchers used two off-the-shelf deep learning models, ProteinMPNN and ESM-IF1, to rewrite the gripping parts of T cell receptors on fixed structural scaffolds, then compared the designs with a physics-based method and with the natural sequences.

1. Curate TCR:pMHC benchmark structures2. Generate TCR sequence designs with ProteinMPNN and ESM-IF13. Generate physics-based baseline designs with Rosetta4. Score designs against native sequences and against V(D)J naturalness5. Model designed sequences with TCRModel26. Score design interfaces and stability with Rosetta7. Benchmark MM/PBSA protocol against experimental affinities8. Estimate design binding affinity by MD and MM/PBSA

spectrum · one line per step, placed by what the step does · bright lines used AI

Exploring the potential of structure-based deep learning approaches for T cell receptor design
PLoS Computational Biology, 2024

doi:10.1371/journal.pcbi.1012489 · record aix-00096 v2 · checked 2026-10-08

ai-resultrole of AI
AI was for
Candidate generation, Structure determination
Model family
Graph neural network, Transformer
Checked by
Held-out32 tested
Code
available

The finding the paper is about came from the AI.

read as

The science is explained before the AI appears. Switch to field specialist to go straight to the method.

Assumes the discipline and goes straight to the method.

The diagram, the record and what the paper did not report are identical in both modes. Only the framing changes — never the evidence.

Introduction by AIxSci · plain language

What this research was about

T cells patrol the body looking for signs of trouble. Each one carries a receptor on its surface that reads short fragments of protein held up by a molecule called the MHC, a kind of display case that shows the cell's contents to the immune system. The receptor grips this fragment-and-case pairing through a handful of flexible loops, known as CDRs. Designing a receptor that grips a chosen target is hard because the loops are small, the contacts are subtle, and the same shape can be made from many different amino acid sequences. Immune receptors also carry a further constraint: real ones are assembled by a genetic shuffling process, so not every sequence is one the body could make.

Some deep learning tools now work backwards from shape to sequence, a task called inverse folding: given the three-dimensional skeleton of a protein, they suggest amino acids that would fit it. The researchers set out to test how well two such tools behave when pointed at T cell receptors. They collected solved receptor-MHC structures from a database, keeping only ones dated after the models' training data ended, so the models could not simply be recalling them.

Where AI came in

ProteinMPNN and ESM-IF1 were run with their released settings, nothing retrained, to generate new receptor sequences on the fixed native skeleton. Design scopes ranged from the CDR3 residues closest to the fragment or the MHC up to the whole variable domain; the rest of the sequence was held fixed, and the bound target was supplied as context except in one control where it was removed. In place of these models, the usual approach is a physics-based design program, and Rosetta was run over the same positions for comparison. Sequence recovery at the designed CDR3 contact positions averaged 43.9 per cent for ProteinMPNN and 50.1 per cent for ESM-IF1 on MHC-I cases, against 31.7 per cent for Rosetta.

A third model, TCRModel2, a receptor-focused version of AlphaFold2, was then used to predict structures for the designed sequences so their backbones and interfaces could be compared with the original crystal structures. Everything else in the assessment was non-learned: counts of germline and natural CDR3 variability, Rosetta interface scoring, and molecular dynamics simulations with free energy calculations. In those simulations, covering seven test cases, most designs showed no significant difference in binding free energy from the native receptor, with lower values than native in one case for ProteinMPNN and three for ESM-IF1. Removing the target from the design input cut maximum sequence recovery by roughly 20 per cent for both models.

Written by AIxSci from the checked record below, to give context for readers outside the field. It is not part of the record.

The work

Technical · from the record

Two structure-based deep learning inverse-folding models, ProteinMPNN and ESM-IF1, were used to redesign T cell receptor interface residues on fixed backbones taken from solved TCR:pMHC structures (32 MHC-I and 6 MHC-II complexes selected to post-date the models' training cut-offs), and the designs were compared with Rosetta Design. Average sequence recovery at designed CDR3 interface positions was 43.9% for ProteinMPNN and 50.1% for ESM-IF1 on MHC-I cases, against 31.7% for the Rosetta FastDesign protocol. Removing the pMHC from the design input reduced maximum sequence recovery by around 20% on average for both models. In MM/PBSA calculations over molecular dynamics trajectories for 7 test cases, most designs showed no significant difference in binding free energy from the native TCR, while designs with significantly lower ΔG than native were obtained in one test case for ProteinMPNN and three for ESM-IF1.

How AI was used

A dataset of solved TCR:pMHC structures was curated to exclude complexes within the ProteinMPNN and AlphaFold2.3 training cut-off dates. For each complex, ProteinMPNN (v_48_020, temperature 0.1) and ESM-IF1 (esm_if1_gvp4_t16_142M_UR50, temperature 0.2) were run with released parameters over the fixed native backbone to generate sequences at designated positions, with non-designed positions held constant; five design scopes were used, from CDR3 residues within 5 Å of the peptide or MHC up to the whole TCR variable domain, and the bound pMHC was supplied as context except in a control where it was removed. Sampling temperature was swept from 0.000001 to 5 and the number of sequences per case from 5 to 500. Rosetta FastDesign was run over the same positions as a physics-based comparison, and randomly substituted dissimilar sequences served as a negative control. Designs were assessed by sequence recovery, physicochemical similarity, uniqueness and entropy, by recovery at buried positions and at hotspots from Rosetta alanine scanning, and by OLGA generation probabilities for the designed CDR3s. Designed sequences were then modelled with TCRModel2, an AlphaFold2-based TCR modelling tool, with max_template_date set to 2021-09-30, and scored by model confidence, CDR backbone RMSD and DockQ; the same designs were scored with Rosetta InterfaceAnalyzer and simulated with Amber molecular dynamics followed by MM/PBSA free energy calculations, a protocol first benchmarked on ATLAS wild-type/mutant pairs with experimental affinities.

The shape of the work

Structural · the record, drawn

PREPARATIONGENERATIONGENERATIONVALIDATIONINFERENCEVALIDATIONVALIDATIONSIMULATION12345678AIAICurate TCR:pMHCbenchmarkstructuresGenerate TCRsequence designswith ProteinMPNN…Generatephysics-basedbaseline designs…Score designsagainst nativesequences and ag…Model designedsequences withTCRModel2Score designinterfaces andstability with R…Benchmark MM/PBSAprotocol againstexperimental aff…Estimate designbinding affinityby MD and MM/PBSA↤ conventional algorithm
AI stepNo AI↤ what the AI stood in for
1Preparation
no AI

Curate TCR:pMHC benchmark structures

Cleaning, filtering, normalising or labelling data already obtained.

Following these filtering steps, a total of 32 and 6 TCR:pMHC structures (MHC-I and MHC-II, respectively) were selectedwhere the paper describes this · verbatim
in the paper
2Generation
AI

Generate TCR sequence designs with ProteinMPNN and ESM-IF1

Producing candidate objects that did not previously exist. The AI stood in for conventional algorithm.

we used the v_48_020 model with default backbone noise (0.00) and sampling temperature of 0.1 to generate 10 designswhere the paper describes this · verbatim
in the paper
3Generation
no AI

Generate physics-based baseline designs with Rosetta

Producing candidate objects that did not previously exist.

A total of 10 designs were generated per test case.where the paper describes this · verbatim
in the paper
4Validation
no AI

Score designs against native sequences and against V(D)J naturalness

Testing outputs against ground truth.

we compared the designed sequence to the native sequence by using the sequence recovery metricwhere the paper describes this · verbatim
in the paper
5Inference
AI

Model designed sequences with TCRModel2

Running a trained model over new data to predict, classify or score.

The ProteinMPNN or ESM-IF1 design sequences were modeled with TCRModel2, a modified version of AlphaFold2 focused on TCR modeling.where the paper describes this · verbatim
in the paper
6Validation
no AI

Score design interfaces and stability with Rosetta

Testing outputs against ground truth.

we employed Rosetta Interface Analyzer, utilizing Rosetta software (version 3.5.1), with the entire protocol executed through RosettaScriptswhere the paper describes this · verbatim
in the paper
7Validation
no AI

Benchmark MM/PBSA protocol against experimental affinities

Testing outputs against ground truth.

we initially benchmarked our protocol to predict free energy changes resulting from mutations in two curated sets of TCR complexeswhere the paper describes this · verbatim
in the paper
8Simulation
no AI

Estimate design binding affinity by MD and MM/PBSA

Numerical or physics simulation, including where a learned surrogate replaces it.

we selected CDR interface designs from 7 TCR:pMHC test cases to perform the MM/PBSA calculations over MD simulation trajectorieswhere the paper describes this · verbatim
in the paper

What the record says

Technical · every part carries its own basis

+ in the paper~ our reading− not reported

How to read the quotations. A quotation shows where the paper describes something. It does not quote every value beside it: one passage locates a part of the work, and values without their own quotation are our reading of that passage.

~Role of AI
AI produced the resultour reading

The object of study is the sequences produced by ProteinMPNN and ESM-IF1; every design evaluated in the paper was generated by these models, so the reported findings exist only because of them.

~What the AI was for
using Graph Neural Networks with Geometric Vector Perceptron layerswhere the paper describes this · verbatim
~Model families
~How it was taught
Zero-shotour reading
~Models named
ProteinMPNN v_48_020 · Off the shelfESM-IF1 esm_if1_gvp4_t16_142M_UR50 (fair-esm v2.0.1) · Off the shelfTCRModel2 · Off the shelfour reading
+How results were checked
Held-out32 testedin the paper
with solved 3D structures that are not included in the ProteinMPNN training dataset (August 31, 2021, date cut-off)where the paper describes this · verbatim
+Code · weights · data
code availableweights not reporteddata not reportedin the paper
The ESM-IF1 design protocol used in our study is available at https://github.com/LBC-LNBio/ESMIFDesignwhere the paper describes this · verbatim
+Compute
GPU-accelerated Amber from AMBER22; 15 replicas per system with 3 ns production runs, 4500 frames used per MM/PBSA calculationin the paper

What this paper did not report

Technical · absence is published deliberately

Reported as not stated — 4 items
  • Trained model weightsWhether the trained model is available is not stated.
  • DataWhether the data are available is not stated.
  • Version of TCRModel2Which version of the model was used is not stated.
  • What step 5 replacedThe paper gives no basis for what the AI stood in for.

About this article

Record aix-00096, version 2, checked by a person on 2026-10-08. The record describes the paper; it does not assess whether the paper's findings are right. The paper is published under CC-BY; quotations are at most 25 words. How we work · Report an error