Opendata, web and dolomites
TransModal SIGNED
Translating from Multiple Modalities into Text
Total Cost €
0EC-Contrib. €
0Partnership
0Views
0TransModal project word cloud
Explore the words cloud of the TransModal project. It provides you a very rough idea of what is the project "TransModal" about.
accessible
models
documentation
deep
familiar
computational
matching
textual
representations
readers
literacy
direct
google
translations
mainstream
unified
human
corpora
units
content
manner
fifty
retrieve
thanks
computers
linguistic
rife
generate
read
unsupervised
extensive
standard
instantly
interactions
framework
descriptions
data
formats
electronic
consisting
sentiment
fundamental
computer
translation
wouldn
individuals
simplifying
render
learning
pair
images
internet
collections
translate
correspondence
translating
types
engineering
tools
intermediate
natural
simplify
induce
code
documents
alike
otherwise
enhanced
summarize
searched
perform
source
learners
databases
modalities
recent
language
query
languages
operate
accessibility
web
retrieval
scalable
Project "TransModal" data sheet
The following table provides information about the project.
| Coordinator |
THE UNIVERSITY OF EDINBURGH
Organization address contact info |
| Coordinator Country | United Kingdom [UK] |
| Project website | https://homepages.inf.ed.ac.uk/mlap/ |
| Total cost | 1˙900˙777 € |
| EC max contribution | 1˙900˙777 € (100%) |
| Programme |
1. H2020-EU.1.1. (EXCELLENT SCIENCE - European Research Council (ERC)) |
| Code Call | ERC-2015-CoG |
| Funding Scheme | ERC-COG |
| Starting year | 2016 |
| Duration (year-month-day) | from 2016-09-01 to 2021-08-31 |
Partnership
Take a look of project's partnership.
| # | ||||
|---|---|---|---|---|
| 1 | THE UNIVERSITY OF EDINBURGH | UK (EDINBURGH) | coordinator | 1˙900˙777.00 |
Map
Project objective
Recent years have witnessed the development of a wide range of computational methods that process and generate natural language text. Many of these have become familiar to mainstream computer users such as tools that retrieve documents matching a query, perform sentiment analysis, and translate between languages. Systems like Google Translate can instantly translate between any pair of over fifty human languages allowing users to read web content that wouldn't have otherwise been available. The accessibility of the web could be further enhanced with applications that translate within the same language, between different modalities, or different data formats. There are currently no standard tools for simplifying language, e.g., for low-literacy readers or second language learners. The web is rife with non-linguistic data (e.g., databases, images, source code) that cannot be searched since most retrieval tools operate over textual data. In this project we maintain that in order to render electronic data more accessible to individuals and computers alike, new types of models need to be developed. Our proposal is to provide a unified framework for translating from comparable corpora, i.e., collections consisting of data in the same or different modalities that address the same topic without being direct translations of each other. We will develop general and scalable models that can solve different translation tasks and learn the necessary intermediate representations of the units involved in an unsupervised manner without extensive feature engineering. Thanks to recent advances in deep learning, we will induce representations for different modalities, their interactions, and correspondence to natural language. Beyond addressing a fundamental aspect of the translation problem, the proposed research will lead to novel internet-based applications that simplify and summarize text, produce documentation for source code, and meaningful descriptions for images.
Publications
| year | authors and title | journal | last update |
|---|---|---|---|
| 2017 |
Spandana Gella, Frank Keller, Mirella Lapata Disambiguating Visual Verbs published pages: 1-1, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2017.2786699 |
IEEE Transactions on Pattern Analysis and Machine Intelligence 27 December 2017 | 2020-02-07 |
| 2017 |
Xingxing Zhang and Mirella Lapata Sentence Simplification with Deep Reinforcement Learning published pages: 595--605, ISSN: , DOI: |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 | 2020-02-07 |
| 2017 |
Jianpeng Cheng, Adam Lopez, and Mirella Lapata A Generative Parser with a Discriminative Recognition Algorithm. published pages: 118--124, ISSN: , DOI: |
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) July, 2017 | 2020-02-07 |
| 2016 |
Zhang, Xingxing and Lu, Liang and Lapata, Mirella} Top-down Tree Long Short-Term Memory Networks published pages: 310--320, ISSN: , DOI: |
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June, 2016 | 2020-02-07 |
| 2017 |
Mallinson, Jonathan and Sennrich, Rico and Lapata, Mirella Paraphrasing Revisited with Neural Machine Translation published pages: 881--893, ISSN: , DOI: |
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017 | 2020-02-07 |
| 2018 |
CARINA SILBERER, JASPER UIJLINGS, MIRELLA LAPATA Understanding visual scenes published pages: 441-465, ISSN: 1351-3249, DOI: 10.1017/s1351324918000104 |
Natural Language Engineering 24/03 | 2020-02-07 |
| 2017 |
Cheng, Jianpeng and Dong, Li and Lapata, Mirella Long Short-Term Memory-Networks for Machine Reading published pages: 551--561, ISSN: , DOI: |
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing November, 2016 | 2020-02-07 |
| 2017 |
Siva Reddy; Oscar Täckström; Slav Petrov; Mark Steedman; Mirella Lapata Universal Semantic Parsing published pages: 89--101, ISSN: , DOI: |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 | 2020-02-07 |
| 2018 |
Yang Liu and Mirella Lapata Learning Structured Text Representations. published pages: 63-75, ISSN: 2307-387X, DOI: |
Transactions of the Association for Computational Linguistics Vol 6 (2018) | 2020-02-07 |
| 2017 |
Dong, Li and Huang, Shaohan and Wei, Furu and Lapata, Mirella and Zhou, Ming and Xu, Ke Learning to Generate Product Reviews from Attributes published pages: 623--632, ISSN: , DOI: |
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017 | 2020-02-07 |
| 2016 |
Gella, Spandana and Lapata, Mirella and Keller, Frank Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings published pages: 182--192, ISSN: , DOI: |
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June, 2016 | 2020-02-07 |
| 2016 |
Dong, Li and Lapata, Mirella Language to Logical Form with Neural Attention published pages: 33--43, ISSN: , DOI: |
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016 | 2020-02-07 |
| 2018 |
Lea Frermann, Shay Cohen, Mirella Lapata Whodunnit? Crime Drama as a Case for Natural Language Understanding published pages: 1-15, ISSN: 2307-387X, DOI: |
Transactions of the Association for Computational Linguistics vol 6 (2018) | 2020-02-07 |
| 2018 |
Stefanos Angelidis and Mirella Lapata Multiple Instance Learning Networks for Fine-Grained Sentiment Analysis published pages: 17-31, ISSN: 2307-387X, DOI: |
Transactions of the Association for Computational Linguistics vol 6 (2018) | 2020-02-07 |
| 2017 |
Zhang, Xingxing and Cheng, Jianpeng and Lapata, Mirella Dependency Parsing as Head Selection published pages: 665--676, ISSN: , DOI: |
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017 | 2020-02-07 |
| 2017 |
Cheng, Jianpeng and Reddy, Siva and Saraswat, Vijay and Lapata, Mirella Learning Structured Natural Language Representations for Semantic Parsing published pages: 44-55, ISSN: , DOI: |
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) July, 2017 | 2020-02-07 |
| 2016 |
Roth, Michael and Lapata, Mirella Neural Semantic Role Labeling with Dependency Path Embeddings published pages: 1192--1202, ISSN: , DOI: |
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016 | 2020-02-07 |
| 2016 |
Cheng, Jianpeng and Lapata, Mirella Neural Summarization by Extracting Sentences and Words published pages: 484--494, ISSN: , DOI: |
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016 | 2020-02-07 |
| 2017 |
Dong, Li and Mallinson, Jonathan and Reddy, Siva and Lapata, Mirella Learning to Paraphrase for Question Answering published pages: 875--886, ISSN: , DOI: |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 | 2020-02-07 |
| 2016 |
Lea Frermann, Mirella Lapata A Bayesian Model of Diachronic Meaning Change published pages: 31-45, ISSN: 2307-387X, DOI: |
Transactions of the Association for Computational Linguistics vol 4 (2016) | 2020-02-07 |
| 2017 |
Liu, Yang and Lapata, Mirella Learning Contextually Informed Representations for Linear-Time Discourse Parsing} published pages: 1289--1298, ISSN: , DOI: |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 | 2020-02-07 |
| 2016 |
Siva Reddy, Oscar Täckström, Michael Collins, Tom Kwiatkowski, Dipanjan Das, Mark Steedman, Mirella Lapata Transforming Dependency Structures to Logical Forms for Semantic Parsing published pages: 127-140, ISSN: 2307-387X, DOI: |
Transactions of the Association for Computational Linguistics vol 4 (2016) | 2020-02-07 |
| 2017 |
Carina Silberer, Vittorio Ferrari, Mirella Lapata Visually Grounded Meaning Representations published pages: 2284-2297, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2016.2635138 |
IEEE Transactions on Pattern Analysis and Machine Intelligence 39/11 | 2020-02-07 |
| 2017 |
Gella, Spandana and Sennrich, Rico and Keller, Frank and Lapata, Mirella Image Pivoting for Learning Multilingual Multimodal Representations published pages: 2829--2835, ISSN: , DOI: |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 | 2020-02-07 |
| 2018 |
Jiangming Liu, Shay B. Cohen, Mirella Lapata Discourse Representation Structure Parsing published pages: 429–439, ISSN: , DOI: |
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | 2020-02-07 |
| 2018 |
Shashi Narayan, Ronald Cardenas, Nikos Papasarantopoulos, Shay B. Cohen, Mirella Lapata, Jiangsheng Yu, Yi Chang Document Modeling with External Attention for Sentence Extraction published pages: 2020–2030, ISSN: , DOI: |
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | 2020-02-07 |
| 2018 |
Laura Perez-Beltrachini, Mirella Lapata Bootstrapping Generators from Noisy Data published pages: 1516-1527, ISSN: , DOI: 10.18653/v1/n18-1137 |
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) | 2020-02-07 |
| 2017 |
Siva Reddy, Oscar Täckström, Slav Petrov, Mark Steedman, Mirella Lapata Universal Semantic Parsing published pages: 89-101, ISSN: , DOI: 10.18653/v1/d17-1009 |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
| 2017 |
Jianpeng Cheng, Siva Reddy, Vijay Saraswat, Mirella Lapata Learning Structured Natural Language Representations for Semantic Parsing published pages: 44-55, ISSN: , DOI: 10.18653/v1/P17-1005 |
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | 2020-02-07 |
| 2017 |
Li Dong, Jonathan Mallinson, Siva Reddy, Mirella Lapata Learning to Paraphrase for Question Answering published pages: 875-886, ISSN: , DOI: 10.18653/v1/d17-1091 |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
| 2016 |
Jianpeng Cheng, Li Dong, Mirella Lapata Long Short-Term Memory-Networks for Machine Reading published pages: 551-561, ISSN: , DOI: 10.18653/v1/D16-1053 |
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
| 2018 |
Narayan, Shashi and
Cohen, Shay B. and
Lapata, Mirella Don’t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization published pages: 1797--1807, ISSN: , DOI: |
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing https://www.aclweb.org/antholog | 2020-02-07 |
| 2018 |
Jonathan Mallinson, Rico Sennrich, and Mirela Lapata Sentence Compression for Arbitrary Languages via Multilingual Pivoting published pages: \"2453--2464\"\", ISSN: , DOI: |
roceedings of the 2018 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
| 2019 |
Ratish Puduppully, Li Dong, and Mirella Lapata Data-to-Text Generation with Content Selection and Planning published pages: , ISSN: , DOI: |
Proceedings of the 33rd International Joint Conference on Artificial Intelligence | 2020-02-07 |
| 2017 |
Jianpeng Cheng, Adam Lopez, Mirella Lapata A Generative Parser with a Discriminative Recognition Algorithm published pages: 118-124, ISSN: , DOI: 10.18653/v1/P17-2019 |
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) | 2020-02-07 |
| 2018 |
Dong, Li; Quirk, Chris; Lapata, Mirella Confidence Modeling for Neural Semantic Parsing published pages: 743–753, ISSN: , DOI: |
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | 2020-02-07 |
| 2018 |
Philip John Gorinski, Mirella Lapata What’s This Movie About? A Joint Neural Network Architecture for Movie Content Analysis published pages: 1770-1781, ISSN: , DOI: 10.18653/v1/n18-1160 |
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) | 2020-02-07 |
| 2018 |
Xingxing Zhang and
Mirella Lapata and
Furu Wei, and
Ming Zhou Neural Latent Extractive Document Summarization. published pages: 779--784., ISSN: , DOI: |
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
| 2017 |
Spandana Gella, Rico Sennrich, Frank Keller, Mirella Lapata Image Pivoting for Learning Multilingual Multimodal Representations published pages: 2839-2845, ISSN: , DOI: 10.18653/v1/D17-1303 |
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
| 2018 |
Dong, Li; Lapata, Mirella Coarse-to-Fine Decoding for Neural Semantic Parsing published pages: 731–742, ISSN: , DOI: |
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | 2020-02-07 |
| 2018 |
Narayan, Shashi; Cohen, Shay B.; Lapata, Mirella Don\'t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization published pages: , ISSN: , DOI: 10.5281/zenodo.2399762 |
Narayan , S , Cohen , S & Lapata , M 2018 , Don\'t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization . in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Brussels, Belgium , pp. 1797-1807 , 2018 Conference on Empirical Methods in Natural Language Processing , Brussels , Belgium , 31/10/18 . 7 | 2020-02-07 |
| 2018 |
Cheng, Jianpeng; Lapata, Mirella Weakly-supervised Neural Semantic Parsing with a Generative Ranker published pages: 356–367, ISSN: , DOI: |
Proceedings of the 22nd Conference on Computational Natural Language Learning | 2020-02-07 |
| 2019 |
Jianpeng Cheng, Siva Reddy, Vijay Saraswat, Mirella Lapata Learning an Executable Neural Semantic Parser published pages: 59-94, ISSN: 0891-2017, DOI: 10.1162/coli_a_00342 |
Computational Linguistics 45/1 | 2020-02-07 |
| 2018 |
Shashi Narayan, Shay B. Cohen, Mirella Lapata Ranking Sentences for Extractive Summarization with Reinforcement Learning published pages: 1747-1759, ISSN: , DOI: 10.18653/v1/n18-1158 |
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) | 2020-02-07 |
| 2018 |
Yang Liu and
Matt Gardner, and
Mirella Lapata Structured Alignment Networks for Matching Sentences published pages: 1554--1564, ISSN: , DOI: |
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
| 2018 |
Stefanos Angelidis and Mirella Lapata Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised published pages: 3675--3686, ISSN: , DOI: |
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing | 2020-02-07 |
Are you the coordinator (or a participant) of this project? Plaese send me more information about the "TRANSMODAL" project.
For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.
Send me an email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.
Thanks. And then put a link of this page into your project's website.
The information about "TRANSMODAL" are provided by the European Opendata Portal: CORDIS opendata.