Questions tagged [linguistics]
The linguistics tag has no usage guidance.
29 questions
-2
votes
1
answer
103
views
How to get a list of all words from an unabridged dictionary?
I wanted to do something that Donald Knuth did. He entered a contest to make as many words as possible out of the phrase/string "Ziegler's Giant Bar". The judges master list had 2 500 words. ...
- 1,765
4
votes
1
answer
74
views
5
votes
1
answer
200
views
Generating language from grammar
To be concrete, consider the following formal grammar:
$$S \rightarrow aSb$$
$$S \rightarrow \varepsilon$$
The language generated by this grammar is $L = \{ a^n b^n | n \geq 0 \}$. How can I implement ...
- 423
1
vote
1
answer
95
views
Atomic Concepts [closed]
WordCloud[WikipediaData["model theory"]]
That is where it starts. I want to now find a new WordCloud with the center inset from the prevous Wordcloud. ...
- 475
5
votes
2
answers
433
views
Frequency rank of Russian words
Mathematica contains the 31801 most frequent Russian words. These can be obtained using:
WordList["KnownWords", Language -> "Russian"]
...
- 7,679
0
votes
0
answers
47
views
Error in function `WordList` in version 12.1
I want to list the number of different kinds of words in the English dictionary (Version 12.1 for Win10 (64-bit)):
...
7
votes
1
answer
243
views
How to remove words added by mistake from spelling check?
In text mode, I mistakenly add a word exx to the dictionary, which makes it impossible to check the spelling of this word. What can I do to delete only the ...
1
vote
1
answer
123
views
How to batch translate a group of words?
I want to translate a group of words into simplified Chinese more quickly:
...
1
vote
2
answers
241
views
Finding position of specific substring within string [closed]
Is there a simple way of finding the position of a specific instance of a substring within a string? For instance, in the sentence "Bob bought his car at the car dealership". Something like <...
- 13
3
votes
0
answers
36
views
How does the SpellingCorrectionList function work? (with confusing example)
I tried the SpellingCorrectionList function on some chunks of code strings to get translation suggestions. The results are kind of wild. I understand guesses are not going to be great on a string of ...
- 131
1
vote
0
answers
56
views
Making a histogram of a dictionary
I am trying to make a histogram of the dictionary where each bin is how many characters in a word, and the height is the frequency of words with that many characters. I'd like to make one for the ...
9
votes
1
answer
1k
views
How to find multi-word synonyms?
I’m looking to write a semantic distance function for phrases (5 words or less) that can map multi-word synonyms together. My domain is e-commerce fashion - here are some required examples for a ...
- 31.8k
16
votes
4
answers
2k
views
What stopwords list is the Wolfram language using?
The documentation of DeleteStopwords only says that it "uses a standard, built-in list of stopwords".
So what is it exactly?
Update
Now that it is said "standard"...
- 9,883
11
votes
0
answers
177
views
How to run GrammarApply offline?
It is a question regarding formal grammar. I have a grammar rule addition as below:-
...
- 3,509
6
votes
2
answers
663
views
Bigrams and TF-IDF calculation
I want to create a bag of bigrams in a set of documents and calculate the TF-IDF vector of each document.
To calculate the bigram of the text I used the following code:
The small example of the data (...
- 2,019
10
votes
2
answers
428
views
Unscrambling jumbled anagrams
I know that we can easily check to see if a string contains any anagrams by the following snippet:
...
- 203
15
votes
3
answers
3k
views
Checking if a word exists
Probably the simplest way to check a word if it exists is to use DictionaryWordQ[]
DictionaryWordQ["color"]
True
But it ...
- 16k
5
votes
2
answers
1k
views
Finding the number of syllables in a string of text
To implement a readability algorithm, I need to find the number of symbols in a long string of text (almost 5000 words). There doesn't seem to be a built-in Mathematica function that can count the ...
- 193
1
vote
0
answers
73
views
Is WordStem available for German?
The WordStem function looks very useful to me. Is there a way to use it for non-English words?
- 1,393
2
votes
1
answer
87
views
Can WordFrequencyData be used with phrases?
Can WordFrequencyData be used with phrases? I'd like to look up words/phrases like "cell phone" instead of "cellphone".
...
- 482
8
votes
1
answer
137
views
How to transform traditional Chinese string into simplified Chinese string in Mathematica?
There are two type of written Characters in Chinese: traditional Chinese and simplified Chinese. Is there a way to transform traditional Chinese string into simplified Chinese string in Mathematica? ...
- 17.4k
7
votes
2
answers
2k
views
How to apply profanity filter
What is the simplest way to filter out profanity from Word Data without manually removing the words?
- 205
0
votes
0
answers
103
views
Filtering word data nouns by subfield?
I am making string combinations using WordData and would like to filter all nouns that come from a specific professional specialization. For example, the nouns in ...
- 21
10
votes
2
answers
3k
views
How do I translate a list of English words into another language using an online translation service with Mathematica?
As far as I know, there are two posts on this topic: Can I use Mathematica to translate a English word to a Chinese characters? and *How can I use Mathematica to get the translated result from the ...
- 17.4k
9
votes
1
answer
903
views
Why does WordList["KnownWords"] include so many non-words?
I was going through the Wolfram Language book in Mathematica and in one chapter had the following exercise to pick out palindromes:
...
- 377
1
vote
1
answer
140
views
Why does WordData fail to find "PartsOfSpeech" when given a list of two words?
I have the following sample code.
StringSplit["a test string", " "]
Thread[WordData[%, "PartsOfSpeech"]]
The output I get is:
...
- 731
28
votes
3
answers
1k
views
Can Mathematica determine part-of-speech for each word in a text?
I've found that WordData has a database of English words and their possible parts of speech. But some words are ambiguous, e.g. result can be a verb or a noun:
<...
- 10.9k
7
votes
2
answers
216
views
DictionaryLookup very slow
I'm trying to plot, given a list of words, how many words belongs to each language.
I'm using the following code:
...
- 1,135
11
votes
2
answers
454
views
WordData for other languages
Mathematica already includes dictionaries for a lot of languages. What I am looking for is a handy semantic/grammatic database for Hungarian, just like WordData for ...
- 47.2k