Questions tagged [natural-language]
Questions about natural language input or text processing.
50
questions
6
votes
1
answer
137
views
How can I tell the WL auto-magic date interpreter to use a day-first interpretation if there is ambiguity?
I know you can use DateObject[{"05-08-2022", {"Day", "Month", "Year" }}] to tell WL the date format explicitly, but a rigid ...
- 21.6k
1
vote
1
answer
67
views
Can WordFrequencyData run faster?
I want the WordFrequencyData of the whole WordList[]
However it takes too long to get the result.
...
- 337
3
votes
0
answers
99
views
FeatureExtraction[] for Text -- to normalize text or not?
The title pretty much captures my question. When I use FeatureExtraction[] for text,
should I normalize text before parsing it through ...
- 5,311
1
vote
1
answer
82
views
Why does Entity Class return an empty value sometimes?
I am working on computing the 20 largest cities in California.
...
- 1,653
1
vote
0
answers
77
views
How to find N most populous cities in each state with TakeLargest and Entity Functions without waiting forever using Caching?
I am interested in using Entity Functions such as EntityValue, FilteredEntityClass, EntityFunction, EntityClass, EntityList, and GeoEntities to help me find N most populous cities in each state. I ...
- 1,653
4
votes
0
answers
126
views
Modern topic modeling?
This question was asked in 2014: How to perform document classification (i.e. extracting topics from text)?
At the time user @V.E. gave a great little tutorial on LDA, but today, there's still no ...
- 31k
2
votes
1
answer
147
views
How do I test that a string is a sentence? [closed]
For example, consider
string = "this is a sentence."
The best way I can think about is DictionaryWordQ. However, <...
- 1,621
2
votes
1
answer
127
views
How to identify gender and family roles of characters in novel excerpts?
I am playing with Natural language programming in Mathematica, and can't figure out how to extract the entity classes (i.e. male, female) for the following example text:
"This was a pleasant ...
- 563
1
vote
2
answers
204
views
Finding position of specific substring within string
Is there a simple way of finding the position of a specific instance of a substring within a string? For instance, in the sentence "Bob bought his car at the car dealership". Something like <...
- 13
10
votes
2
answers
337
views
Removing banal words from a list
NB: I am aware of the DeleteStopwords symbol.
I want to remove from a list of words the ones that are likely to be more banal. So for instance if we have
...
- 1,721
3
votes
1
answer
324
views
Entering natural language input in WolframScript
What is the equivalent of typing = at the beginning of a line to specify natural language input in WolframScript?
- 161
4
votes
0
answers
107
views
Can Mathematica show Hebrew,Arabic and Persian languages correctly?
Right to left languages don't show correctly in Mathematica ,is there a way to type RTL languages without them being reversed?
- 41
7
votes
1
answer
251
views
Decoding Music in Staff Notation using ImageIdentify
I wrote this Code fragment
Which is a E (quarter) note in Treble Clef. Instead Mathematica simply classified it as a "musical note"
Can we do better?
- 1,616
5
votes
1
answer
397
views
How to paraphrase text?
I'm looking to train or use pre-trained models in order to re-phrase text. Are there any natural language models in the Wolfram Neural Repository (or elsewhere) that can be used to paraphrase text?
...
- 3,561
1
vote
0
answers
43
views
SpellingCorrectionList for custom language (Italian)
SpellingCorrectionList["ciao",Language -> Italian]
Says there are no Spelling dictionaries for Italian.
On the other hand, ...
- 2,030
6
votes
0
answers
100
views
An efficient way to extract Dependency Strings from a sentence
Mathematica has the built-in function TextStructure, with the option "DependencyStrings" that provides the dependency strings of a sentence. Unfortunately, this function is incredibly slow.
...
- 537
3
votes
1
answer
749
views
Difference between free-form input via WolframAlpha[] and CTRL+=
WolframAlpha["query"] - https://reference.wolfram.com/language/ref/WolframAlpha.html
Free-form input - https://reference.wolfram.com/language/workflow/EnterFreeFormInput.html
For example:
...
- 1,139
4
votes
1
answer
88
views
Assigning probabilities to an Autocomplete function
I have created an autocomplete function based on WordList.
auto = Autocomplete[WordList["KnownWords"]]
And if I use this on the letters "ga", it will provide me ...
- 537
3
votes
0
answers
109
views
NLP in non-english languages possible?
I would like to use Mathematica NLP functions to analyze texts in French. I haven’t found any documentation on how good it will be compared to english (and if it’s even possible to use non-english ...
- 2,135
9
votes
1
answer
1k
views
How to find multi-word synonyms?
I’m looking to write a semantic distance function for phrases (5 words or less) that can map multi-word synonyms together. My domain is e-commerce fashion - here are some required examples for a ...
- 31k
0
votes
1
answer
197
views
Error Code 414 while trying to do a substitution
I was trying to see what would happen if I let d=q in the following equation:
...
6
votes
1
answer
326
views
Named entity recognition
How can one process natural language (English) to extract named entities (aka NER)? Or at least, entities which can be mapped to a Mathematica Entity. Note that trying to map entities via simple ...
7
votes
0
answers
179
views
How to import unsupported language dictionaries?
Mathematica seems to only know about these 27 languages:
However, I need access to dictionaries for other languages, namely Romanian and Japanese. Now, WordList ...
- 3,561
3
votes
2
answers
977
views
2
votes
0
answers
75
views
Extracting Parts of Speech
I am looking to parse the ConstituentsTree from TextStructure.
Someone already asked how to get the proper nouns out of a text here:
Extract names from a document
I am looking for a more general ...
- 41
4
votes
1
answer
348
views
7
votes
1
answer
461
views
A strange verb from Mathematica's WordList
The first word returned by WordList["Verb"] is "aah", even though I think it actually an interjection, I still wonder whether ...
- 9,523
1
vote
1
answer
183
views
Plot with Wolfram Alpha Scientific Data
Now that Mathematica has already embedded Wolfram Alpha, so I'd like to plot a graph: "Air Density" - "Elevation".
I know that
yields
But I can't do that 10000 ...
- 115
5
votes
2
answers
260
views
Split up word pairs in string based on semantic textual analysis
I have several hundred sentence-strings with joined words. They were extracted from a text (and are in sequence).
Here is an example of one:
...
- 7,349
9
votes
3
answers
561
views
Number of capital letters
I am interested in counting a number of uppercase letters in the text. I do it in the following manner.
...
- 1,979
2
votes
0
answers
67
views
Confusing behavior for GrammarRules and GrammarApply
I have been experimenting with GrammarRules in an attempt to create a parser for text downloaded from the web. I have been using Interpreter to help understand the behavior of GrammarApply. Here is a ...
- 691
4
votes
0
answers
166
views
Can someone help me to understand sequence-to-sequence transformation using (Wolfram-specific) recurrent neural nets?
I've been learning about recurrent neural networks lately and I think I'm starting to get the basic idea of how they work. I'm particularly interested in the sequence transformation capabilities of ...
- 41
6
votes
2
answers
231
views
Average length (in words) of paragraphs in document
I try to calculate the average length (in words) of paragraphs in a document. The data look like:
...
- 1,979
6
votes
2
answers
617
views
Bigrams and TF-IDF calculation
I want to create a bag of bigrams in a set of documents and calculate the TF-IDF vector of each document.
To calculate the bigram of the text I used the following code:
The small example of the data (...
- 1,979
3
votes
1
answer
178
views
Specify NetEncode's tokenization model?
NetEncoder[{"Tokens"}] uses WordData indices to tokenize an input string. But is there a way to tell ...
- 31k
6
votes
1
answer
175
views
Counting a part of the speech in a sentence
I want to count a number of nouns in a sentence. For that, I'm using TextStructere but I don't know how to get tags of each word.
- 1,979
2
votes
2
answers
240
views
Searching words with the five vowels
after looking for a long time manually words in Spanish that have the five vowels in any order, for example Republicano, murcielago, superiora, etc; I'm bored and without success. I thought that ...
- 1,239
10
votes
2
answers
408
views
Unscrambling jumbled anagrams
I know that we can easily check to see if a string contains any anagrams by the following snippet:
...
- 203
4
votes
1
answer
177
views
Manually plotting the 'sheep curve'
There are a number of 'popular' parametric plots that draw recognisable pictures - of course I must learn more about the 'sheep curve'.
It's straightforward to 'find' them using a natural language ...
- 1,437
5
votes
1
answer
198
views
Languages/scripts supported by Alphabet[]
How can I get the full list of languages/scripts/alphabets supported by the Alphabet function?
Note that while the auto-completion suggests many possibilities, it ...
- 232k
2
votes
0
answers
224
views
Sentimental Analysis Classification Problem [closed]
I am keen on working with Mathematica for my sentimental analysis project. I have just started and been working around with some examples. During which I found:
...
- 21
2
votes
0
answers
68
views
Another question on Mma data sources/syntax
Let's say I want to have the vapor pressure of mercury, as a function of temperature. I know that this information is available, for any specific temperature, from Wolfram Alpha, and I can also get ...
- 4,129
17
votes
1
answer
544
views
Programming of a natural language interface
I've just started using the Mathematica natural language interface and found it very interesting. After doing some research, I found some documentation on the "Programmable Linguistic Interface":
...
- 403
1
vote
0
answers
202
views
Why do I get different results for the same input specified using natural language phrasing? [closed]
One of the comments to Stephen Wolfram's blog post on Ada Lovelace, mentioned that WolframAlpha (and verified in Mathematica as well) provided slightly different results for the question of Ada's age ...
- 377
1
vote
0
answers
95
views
What's in a Name? [closed]
StringReplacePart["StringReplacePart","At",{14,17}] ... Surely you can't be serious? ...
Naming Matters: I think what and how we call things is ...
- 6,046
1
vote
0
answers
296
views
Alternatives to Mathematica that are not computer algebra systems [closed]
Are there alternatives to Mathematica that are not computer algebra systems?
I know there have been questions on this, but I am focusing on oprn source projects and instead of focusing on computer ...
- 111
12
votes
2
answers
589
views
Comparing natural language strings
I have a large spreadsheet with thousands of rows/columns of text. Some are saying essentially the same thing but in different ways.
When you enter a natural language question Wolfram Alpha makes a ...
- 433
3
votes
1
answer
238
views
How to get free-form linguistic input to act on a previous output?
It seems that Mathematica is capable of taking free-form input that acts on previous outputs (see "separate color channels"), but I'm having trouble getting it to work in my case.
I've got ...
- 6,403
3
votes
0
answers
434
views
Mixing Wolfram Language & WolframAlpha Queries - How robust is it?
The advent of Mathematica in the cloud and linguistic input potentially transforms expectations of the Wolfram Language's programming model and its inherent robustness. An example of this comes form ...
- 6,046
12
votes
3
answers
2k
views
Convert number to word
I have a big number like: 123 456 789. Now I'll to writ it like this
123 million 456 thousand 789
I've search on the internet but nothing found that works.
How can you do that?
Thanks.
- 145