Questions tagged [dataset]
Questions on the Dataset data type and related functionality introduced in version 10. Do not use for questions on data in more generic list format or data-manipulation questions generally.
71
questions with no upvoted or accepted answers
20
votes
0answers
204 views
Inefficient memory storage for Dataset
Why Dataset doesn't serialize its contents, isn't it the whole point? I expect it to behave similar to python's pandas.DataFrame,...
12
votes
0answers
217 views
Internal error using part specification with Dataset
Bug introduced in 12.1.0. Fixed in 12.1.1
Update 2020-04-13
WRI has confirmed that this is a bug. CASE:4530401
Suggested workaround from WRI
...
10
votes
0answers
777 views
Dataset in Mathematica 10.0.1
Wolfram pages "Mathematica Quick Revision History" in Mathematica 10.0.1 release says:
"New operators and compositions of operators enabled for associations
functions such as Dataset and Query"
...
9
votes
0answers
302 views
How can I add column-rearrangement-by-mouse-dragging to my dataset display function?
A subject that I seem to take at heart...
I was expecting an upgrade of the default Dataset display in MMA 10.3.1. It did not happen. Among the features I would have liked to see improved is a better/...
8
votes
0answers
256 views
Wolfram Desktop 12.1 fonts are inconsistent within various interfaces of the frontend?
I just installed the Wolfram Desktop 12.1 clean install on windows by first completely uninstalling all previous versions so previous settings don't impact the new installation.
The new front end for ...
7
votes
0answers
70 views
Dataset Crashes Information and Definition functions
Bug in 11.0.1 fixed in 11.1.0
Has anyone else noticed this odd function crash with Datasets. Try the following in a clean kernel.
...
7
votes
0answers
83 views
How to navigate a large Dataset with keyboard short-cuts?
Update : Starting in 11.1 the navigation buttons are fixed to the left-hand side instead of being centered and don't jump around anymore.
Starting with version 11.0 ...
5
votes
0answers
266 views
Why is Transpose Dataset slow in one direction
Transpose is faster when it distributes Keys at the 2nd level of a Dataset than when it factors them out.
...
4
votes
0answers
50 views
How can I export a Dataset with graphics as an Excel file?
I would like to export a Dataset to Excel. The Dataset contains graphics. But the following does not work:
...
4
votes
0answers
74 views
Is this the most idiomatic way to convert matrix into dataset?
Is this the most idiomatic way to convert matrix into dataset? (for Mathematica 10 or higher)
I was kind of hoping this would work:
...
4
votes
0answers
189 views
4
votes
0answers
98 views
Scrolling Dataset with down arrow hangs its display
Update : same in v 11.3.0 (OSX) (so bad, it just froze completly the Front End and I had to kill by hand ... and I lost some work !!! Be careful)
It's rather an annoying problem i've got many times ...
4
votes
0answers
115 views
Dataset row position changed by GroupBy in 11.0.1
Bug introduced in 11.0.0 and persisting through 11.0.1 or later
In 10.4.1 and previous versions then using GroupBy in a Dataset ...
4
votes
0answers
102 views
Parallelize Dateset query
I would like to evaluate a Dataset query in parallel, my latest approach being:
...
3
votes
0answers
42 views
BoxWhiskerChart features breaking with massive WeightedData datasets
I have huge WeightedData objects (500K) that I am trying to plot in BoxWhiskerChart. I can get the default chart, but if I try and use the "Outliers" option, it breaks and hits a recursion ...
3
votes
0answers
115 views
Display of datasets
This question is again related to the improper font sizes used in the Windows versions of Mathematica, including version 12.1: Is there a way to change the font size used in the display of Datasets? ...
3
votes
0answers
50 views
How to implement with Rlink and RFunction the mblm non parametric regression library in R
See (https://cran.r-project.org/web/packages/mblm/index.html)
I would imagine this could be done analoge to a blog from 2013 by Jon Mcloone (https://blog.wolfram.com/2013/05/22/why-would-a-...
3
votes
0answers
129 views
Adjusting opacity in map overlays
I am currently working with rainfall data from hurricane Harvey in order to better understand how to allocate resources in the event of another disaster. I want to accomplish a few things given this ...
3
votes
0answers
62 views
Aligning input form of a sequence of Queries
Is there a way to modify the parser, or define options, to align the indentation of a sequence of Queries on a Dataset?
Given:
ds = <|"a" -> 1, "b" -> <|"c" -> 2|>,
"d" -> <|"e" -> 3, "f" ...
3
votes
0answers
97 views
Data Interpolation of deaths by date
I am working with an ebola dataset from Guinea, 2014:(http://currents.plos.org/outbreaks/article/estimating-the-reproduction-number-of-zaire-ebolavirus-ebov-during-the-2014-outbreak-in-west-africa/).
...
3
votes
0answers
188 views
Dataset fails to present data in some instances when inserting new data
Update: I solved the problem: the error will occur when the length of an association is less than the length of the longest association in the association of associations
In my original problem I ...
3
votes
0answers
100 views
Export to MX seems to corrupt the in-memory Dataset
I have a function that does a large number of calculations (by calling out to other smaller functions), and then builds a large Dataset object. Then I do two ...
3
votes
0answers
83 views
Encourage SemanticImport to assume numbers?
I would like to import a CSV without specifying the data type of each column before hand. SemanticImport almost does it, but doesn't appear to recognize numeric ...
3
votes
0answers
293 views
Combining key pivoting and lookup operators in Dataset
This question is related to this one re pivoting on keys.
Because of the nesting, using Leonid's method as starting point - single key:
...
2
votes
0answers
101 views
Replacing an part in a dataset
I have a nested dataset, which has been created to be the correct size from using Table, and I wish to replace parts of the dataset with the data. My dataset would look like (with placeholder values ...
2
votes
0answers
42 views
2
votes
0answers
39 views
How can I efficiently save multidimensional data that is retrievable by key?
I am doing some simulations in Mathematica, where I calculate a spectrum intensity(frequency) for a variation of parameters in my samples. So in the following image, for example, I vary the charge ...
2
votes
0answers
54 views
2
votes
0answers
59 views
Efficiently get positions of Query results
I have some very large Datasets. Is there any efficient method of getting the positions of results found in a Query? That is, without using ...
2
votes
0answers
101 views
2
votes
0answers
111 views
Converting Datasets into EntityStores: best practice?
The advent of the family of *edEntityClass functions in V12 looks very promising. Dataset and its related queries are ideal for ...
2
votes
0answers
63 views
2
votes
0answers
62 views
one Dataset from multiple csv files
In one folder I have many csv files, all sharing an identical header. I can use SemanticImport to produce a Dataset from each ...
2
votes
0answers
48 views
Calculate the precision@k in Classify
I am interested to measure a precision@k. The Classify function provides a build in an option for that or an elegant approach to calculate this without the need to ...
2
votes
0answers
97 views
List, Association, and Dataset, according to what principles to choose which one to use?
List, Association and Dataset are three 'objects' that can be used to store data in MMA. So ...
2
votes
0answers
68 views
Max Size for SemanticImport?
Does anyone know what the max data size for SemanticImport is?
I have a 4GB data file I need to break down, just don't know how small I have to break it.
Thanks!
2
votes
0answers
47 views
Expose TimeObject fractions of a second and user-defined formatting
The default TimeObject formats (doc page), don't display fractions of seconds:
...
2
votes
0answers
840 views
How do I obtain the Fisher Information Matrix from a data set?
My apologies in so much as this is probably in large part a problem of me not being aware of the necessary mathematics but since this should be a common issue in machine learning and Mathematica now ...
1
vote
0answers
30 views
Dataset changes layout depending on value types
I've been looking to using datasets for the sometimes nice layout and scrolling possibilities.
However I've been trying to find a way to "force" the layout when using nested tables.
I can't ...
1
vote
1answer
64 views
Sort a nested Association by another Association
I have a nested association of numerous pixel values sorted by sample date (e.g. 20190422C) and futher by a strain percentage (e.g. 0, 30, 50).
I want to sort it even further using and Association of ...
1
vote
0answers
60 views
Wikipedia Edits History: how to split edit history and comments
I am trying to import Wikipedia Edit History. The code that I am using is the following:
...
1
vote
0answers
158 views
How to handle exceptions and failures in Mathematica?
In python I can write fallback values like:
...
1
vote
0answers
73 views
1
vote
0answers
35 views
Issues with Manipulate (or variable assignment)
I am working to take a large manipulator I have built and generalize it, but I keep running into some variable assignment issue.
I made a short example of my issues below:
Set up:
...
1
vote
0answers
132 views
What is a good way to store TimeSeries objects?
This is a question about proper ways to save and retrieve TimeSeries.
I am processing data from two separate sources and compile around 150 ...
1
vote
0answers
59 views
How to: `GeneralizedLinearModelFit` with `Dataset` with cofactors
Please do not think of this question as a more general extension of LinearModelFit with Dataset asked by @alan, and answered by @Weach.
The original question (or at least the solution) pertained more ...
1
vote
0answers
52 views
Error when selecting row and column with Dataset[]
I read in my data using:
dat=Dataset[Import["dat.csv"]]
When I view the data it appears correct.
However, when I execute a command like
...
1
vote
0answers
63 views
Dataset inactive when shown from button action
Bug introduced in 11.1.1 (or earlier) and persisting through 11.3
CASE:3919858
This dataset is active:
...
1
vote
0answers
109 views
Numbers not treated as numbers
I'm apologize for the stupidity of this question, but I've run out of ideas. I have some data saved in a mx file. When imported, MM isn't treating the values as numbers.
For instance:
...
1
vote
0answers
34 views
DO Button: convert databin entry from String to Reals
I am learning to use the Wolfram databins and DO Button and DO Note apps for a personal project.
The sample code I am using as the Recipe is:
...