• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Paul Clapham
  • Ron McLeod
  • Liutauras Vilda
  • Bear Bibeault
Sheriffs:
  • Jeanne Boyarsky
  • Tim Cooke
  • Devaka Cooray
Saloon Keepers:
  • Tim Moores
  • Tim Holloway
  • Piet Souris
  • salvin francis
  • Stephan van Hulst
Bartenders:
  • Frits Walraven
  • Carey Brown
  • Jj Roberts

TensorFlow 2.0 in Action: Synthesising Data For NLP

 
Ranch Hand
Posts: 35
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Thushan.

Apologies for asking lots of questions, but I need to transfer all your knowledge into my brain before the end of Friday.

With images as the input data it is easy to synthesise lots of data from a smaller dataset.
Are there techniques we can use with Natural Language Processing to synthesise data automatically? What if the subject matter is focussed on some technical area, so randomly changing words, even if they are synonyms, is not really an option?


Thanks
Don.
 
Author
Posts: 24
2
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hey Don,

Happy to answer as many questions as I can.

As you say, for Images you can augment data simply through matrix/vector transformations.

For NLP, it gets tricky. The synonym approach is good, but it also might end up changing the meaning of your sentences in special circumstances. One think you might be able to try is randomly drop stop words. On another note, if you get global frequency statistics of the corpus, you can drop words based on probability calculated from the frequency of words (e.g. more frequent words dropped more). But again, you need to be careful, as this can end up changing the meaning of the sentences.

 
Don Horrell
Ranch Hand
Posts: 35
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Interesting thoughts.

It would be very easy to change the meaning of a sentence by removing a small, common word like "not".
 
reply
    Bookmark Topic Watch Topic
  • New Topic