Questions tagged [dataset]
Questions on the Dataset data type and related functionality introduced in version 10. Do not use for questions on data in more generic list format or data-manipulation questions generally.
54
questions with no upvoted or accepted answers
18
votes
0answers
167 views
Inefficient memory storage for Dataset
Why Dataset doesn't serialize its contents, isn't it the whole point? I expect it to behave similar to python's pandas.DataFrame,...
16
votes
2answers
321 views
Dataset shows an “All” Key when it contains a List of Associations
From a process I have a Dataset similar to this minimal example.
...
10
votes
0answers
773 views
Dataset in Mathematica 10.0.1
Wolfram pages "Mathematica Quick Revision History" in Mathematica 10.0.1 release says:
"New operators and compositions of operators enabled for associations
functions such as Dataset and Query"
...
9
votes
0answers
265 views
How can I add column-rearrangement-by-mouse-dragging to my dataset display function?
A subject that I seem to take at heart...
I was expecting an upgrade of the default Dataset display in MMA 10.3.1. It did not happen. Among the features I would have liked to see improved is a better/...
7
votes
0answers
66 views
Dataset Crashes Information and Definition functions
Bug in 11.0.1 fixed in 11.1.0
Has anyone else noticed this odd function crash with Datasets. Try the following in a clean kernel.
...
7
votes
0answers
80 views
How to navigate a large Dataset with keyboard short-cuts?
Update : Starting in 11.1 the navigation buttons are fixed to the left-hand side instead of being centered and don't jump around anymore.
Starting with version 11.0 ...
5
votes
0answers
250 views
Why is Transpose Dataset slow in one direction
Transpose is faster when it distributes Keys at the 2nd level of a Dataset than when it factors them out.
...
4
votes
0answers
38 views
How to preserve Dataset's pagination inside Manipulate?
I'm having troubles preserving automatic pagination provided by Dataset when it is embedded in a Manipulate.
Consider the ...
4
votes
0answers
61 views
Is this the most idiomatic way to convert matrix into dataset?
Is this the most idiomatic way to convert matrix into dataset? (for Mathematica 10 or higher)
I was kind of hoping this would work:
...
4
votes
0answers
71 views
Scrolling Dataset with down arrow hangs its display
Update : same in v 11.3.0 (OSX) (so bad, it just froze completly the Front End and I had to kill by hand ... and I lost some work !!! Be careful)
It's rather an annoying problem i've got many times ...
4
votes
0answers
105 views
Dataset row position changed by GroupBy in 11.0.1
Bug introduced in 11.0.0 and persisting through 11.0.1 or later
In 10.4.1 and previous versions then using GroupBy in a Dataset ...
3
votes
0answers
117 views
Adjusting opacity in map overlays
I am currently working with rainfall data from hurricane Harvey in order to better understand how to allocate resources in the event of another disaster. I want to accomplish a few things given this ...
3
votes
0answers
58 views
Aligning input form of a sequence of Queries
Is there a way to modify the parser, or define options, to align the indentation of a sequence of Queries on a Dataset?
Given:
ds = <|"a" -> 1, "b" -> <|"c" -> 2|>,
"d" -> <|"e" -> 3, "f" ...
3
votes
0answers
90 views
Parallelize Dateset query
I would like to evaluate a Dataset query in parallel, my latest approach being:
...
3
votes
0answers
88 views
Data Interpolation of deaths by date
I am working with an ebola dataset from Guinea, 2014:(http://currents.plos.org/outbreaks/article/estimating-the-reproduction-number-of-zaire-ebolavirus-ebov-during-the-2014-outbreak-in-west-africa/).
...
3
votes
0answers
181 views
Dataset fails to present data in some instances when inserting new data
Update: I solved the problem: the error will occur when the length of an association is less than the length of the longest association in the association of associations
In my original problem I ...
3
votes
0answers
89 views
Export to MX seems to corrupt the in-memory Dataset
I have a function that does a large number of calculations (by calling out to other smaller functions), and then builds a large Dataset object. Then I do two ...
3
votes
0answers
270 views
Combining key pivoting and lookup operators in Dataset
This question is related to this one re pivoting on keys.
Because of the nesting, using Leonid's method as starting point - single key:
...
2
votes
0answers
65 views
2
votes
0answers
37 views
2
votes
0answers
84 views
Converting Datasets into EntityStores: best practice?
The advent of the family of *edEntityClass functions in V12 looks very promising. Dataset and its related queries are ideal for ...
2
votes
0answers
41 views
2
votes
0answers
33 views
one Dataset from multiple csv files
In one folder I have many csv files, all sharing an identical header. I can use SemanticImport to produce a Dataset from each ...
2
votes
0answers
43 views
Calculate the precision@k in Classify
I am interested to measure a precision@k. The Classify function provides a build in an option for that or an elegant approach to calculate this without the need to ...
2
votes
0answers
113 views
2
votes
0answers
94 views
List, Association, and Dataset, according to what principles to choose which one to use?
List, Association and Dataset are three 'objects' that can be used to store data in MMA. So ...
2
votes
0answers
64 views
Max Size for SemanticImport?
Does anyone know what the max data size for SemanticImport is?
I have a 4GB data file I need to break down, just don't know how small I have to break it.
Thanks!
2
votes
0answers
76 views
Encourage SemanticImport to assume numbers?
I would like to import a CSV without specifying the data type of each column before hand. SemanticImport almost does it, but doesn't appear to recognize numeric ...
2
votes
0answers
45 views
Expose TimeObject fractions of a second and user-defined formatting
The default TimeObject formats (doc page), don't display fractions of seconds:
...
2
votes
0answers
664 views
How do I obtain the Fisher Information Matrix from a data set?
My apologies in so much as this is probably in large part a problem of me not being aware of the necessary mathematics but since this should be a common issue in machine learning and Mathematica now ...
1
vote
0answers
43 views
Wikipedia Edits History: how to split edit history and comments
I am trying to import Wikipedia Edit History. The code that I am using is the following:
...
1
vote
0answers
65 views
1
vote
0answers
33 views
Issues with Manipulate (or variable assignment)
I am working to take a large manipulator I have built and generalize it, but I keep running into some variable assignment issue.
I made a short example of my issues below:
Set up:
...
1
vote
0answers
91 views
What is a good way to store TimeSeries objects?
This is a question about proper ways to save and retrieve TimeSeries.
I am processing data from two separate sources and compile around 150 ...
1
vote
0answers
57 views
How to: `GeneralizedLinearModelFit` with `Dataset` with cofactors
Please do not think of this question as a more general extension of LinearModelFit with Dataset asked by @alan, and answered by @Weach.
The original question (or at least the solution) pertained more ...
1
vote
0answers
59 views
Dataset inactive when shown from button action
Bug introduced in 11.1.1 (or earlier) and persisting through 11.3
CASE:3919858
This dataset is active:
...
1
vote
0answers
105 views
Numbers not treated as numbers
I'm apologize for the stupidity of this question, but I've run out of ideas. I have some data saved in a mx file. When imported, MM isn't treating the values as numbers.
For instance:
...
1
vote
0answers
33 views
DO Button: convert databin entry from String to Reals
I am learning to use the Wolfram databins and DO Button and DO Note apps for a personal project.
The sample code I am using as the Recipe is:
...
1
vote
0answers
51 views
MedianDeviation upsets Dataset in 10.3.1
This seemingly innocent piece of code seems to choke the interpreter somewhere...
...
1
vote
0answers
92 views
Changing default display behaviour for Dataset
I have a function (whose code is in this site) to display Dataset in a more convenient way. To the extent that I never use the default one. I find myself constantly ...
1
vote
0answers
80 views
Custom drop-down list of tags for Dataset Keys similar to CountryData
CountryData produces a drop-down list of tags when you enter a string.
I would like to replicate this functionality for a ...
1
vote
0answers
92 views
Multiplying two sets of data (x,y values, but different x density) followed by integration of the product
I've been trying to do this by myself today, but no luck yet. Please, see attached image.
Basically, I do have two data sets A (x1,y1) and ...
1
vote
0answers
90 views
0
votes
0answers
35 views
Finding Fourier transform of a quantity v/s theta (0 to 360 degrees)
I have a physical quantity (experimentally measured) lets say T whose variation I have measured with angle (theta in degrees). I want to find out the Fourier components of this quantity with respect ...
0
votes
0answers
16 views
SemanticImport adds garbage characters to key name
I want to import a csv to a dataset. This exact dataset successfully imported on a PC, but on a Mac one of the columns has garbage characters added to the key (see below example). I don't believe ...
0
votes
0answers
26 views
How to count n observations/ rows in a table?
What is the expression to count the rows/ observations?
This is how I entered data:
...
0
votes
0answers
23 views
How do I apply GeoRegionValuePlot to a grouped Dataset?
I have a database like the one under this question which I transform into a Dataset by applying
...
0
votes
0answers
52 views
How to handle exceptions and failures in Mathematica?
In python I can write fallback values like:
...
0
votes
0answers
111 views
Import Stackoverflow data and convert it into dataset
I have an xml file with the tag data from Stackexchange:
https://archive.org/download/stackexchange/stackoverflow.com-Tags.7z
After I unzip it I would like to import it to Mathematica to some ...
0
votes
0answers
46 views
Error when selecting row and column with Dataset[]
I read in my data using:
dat=Dataset[Import["dat.csv"]]
When I view the data it appears correct.
However, when I execute a command like
...
