Questions on the Dataset data type and related functionality introduced in version 10. Do not use for questions on data in more generic list format or data-manipulation questions generally.

learn more… | top users | synonyms

0
votes
2answers
57 views

Short way to query Dataset by the value of several columns

I learned how to query Dataset for rows that contain a certain value, but now I need to query for a long series of And in chain ...
0
votes
0answers
74 views

Fitting Data using GeometricBrownianMotionProcess

I am trying to fit Data (see below) using a GeometricBrownianMotionProcess, and have attached two figures. One figure is that of the Data, and the other of the GeometricBrownianMotion for given ...
1
vote
2answers
38 views

Converting data set from one form to another

I wish to convert Data to Data2. Both sets are provided below. Note that the second set has an arbitrary parameter "t". How can this be done. ...
4
votes
1answer
103 views

How to analyze all the data in a directory

I am trying to import, analyze, and save all the .txt files in a specific directory. I can do this with a single .txt file using the following code: ...
12
votes
1answer
143 views

best practices for saving Datasets and TemporalData to a SQL database

I have been working with a simulation tool that generates large volumes of data, and it's time to start saving this to a proper database. Is there an established mechanism for saving TemporalData ...
8
votes
0answers
50 views

Operating on a dataset named “data” triggers an error message [duplicate]

Update: With thanks to the editor, it was made clear to me that this is due to a bug in some packages autoloaded during some operations on Dataset expressions. Nothing to do with the name of the ...
3
votes
0answers
36 views

Why this shadowing when dealing with a dataset? [duplicate]

I have a dataset which I use as "dsall" and a function keylist (just for my convenience, nothing spectacular): ...
1
vote
0answers
29 views

Custom drop-down list of tags for Dataset Keys similar to CountryData

CountryData produces a drop-down list of tags when you enter a string. I would like to replicate this functionality for a ...
4
votes
0answers
73 views

Convert .csv Dataset and store in Databin [closed]

Trying out the new Databin product in the Wolfram Cloud. I have a simple ,-delimited .csv file with a header row which I have imported using the follwing: ...
11
votes
0answers
102 views

How does Dataset compare to DataFrame in pandas?

Pandas is a Python package providing fast, flexible, and expressive data structures designed to make working with “relational” or “labeled” data. Just like ...
19
votes
1answer
245 views

Visualizing Type System Operations

With the introduction of Dataset in version 10, Mathematica acquired a static type-checking subsystem. A fair number of dataset-related questions here on MSE ...
18
votes
2answers
266 views

Dataset seems to break Information

Bug present in version 10.2 My little function, from pre-10.2 ,to turn a headed table into a Dataset. ...
8
votes
2answers
80 views

Using Merge[Identity] and Transpose on a Dataset

While experimenting with this answer, I ran across the following: ...
10
votes
1answer
107 views

Odd StringTake problem in Dataset

10.2 Win64 Works fine... Dataset[{<|"a"->"ABC"|>}][All, StringTake[#a,{1,3}]&] Explicitly taking the whole string using its length directly. ...
7
votes
1answer
121 views

Converting a Table to a Dataset

I feel like this is a simple task, and there may be a built in method to doing this (but I can't find it if there is). I would like to be able to take a table and convert it into a structured Dataset. ...
10
votes
1answer
189 views

Streaming`LazyList`Testing may have a leak

Version 10.2; Win64 Enterprise. I'm seeing this message... data::shdw: Symbol data appears in multiple contexts {Streaming`LazyList`Testing`, Global`}; definitions in context ...
3
votes
1answer
52 views

Hold[Dataset[__]] not holding

With Hold[Dataset[Random[]]] instead of an expected Hold[Dataset[Random[]]] Can ...
17
votes
2answers
333 views

10.2 Dataset extraneous print using Transpose

Bug introduced in 10.2 and fixed in 10.2 (by paclet update GeneralUtilities 10.2.1) This is probably patch code in 10.2. Is there a way to turn off print with ...
22
votes
2answers
352 views

Dataset vs an association of associations

Associations with a record structure (e.g., a flat table) can be organised in one of two main ways. First as a list of associations, which is also used in the case of Mathematica's data set ...
0
votes
0answers
42 views

How to Export a mixture distribution to .json file

I would like to export the following mixture distribution mathematica found for my dataset to .json file ...
13
votes
2answers
242 views

Exporting Dataset to WDX format fails

I reported this to WRI support. Tracking number is CASE:3368636 Official answer is: Thank you for contacting Wolfram Technical Support. This is a known issue and our developers are working on a ...
4
votes
1answer
100 views

Query Dataset to check if row contains any from a set of values

For a given keyless dataset, I can query to return the rows whose columns contain a specific value. For example: ...
7
votes
4answers
256 views

How to iterate over the columns of a Dataset?

I have a Dataset with a simple structure, like this: ...
6
votes
2answers
196 views

Cutting away points that are not resonances

My situation is as follows. I have a whole bunch of data that I need to fit, which tends to look like this picture: As can be seen, there's three dips (resonances) and a whole bunch of noise around ...
5
votes
2answers
100 views

Dataset breaks multi-character StringSplit

Given ds = Dataset[{"a b", "c-d"} ] multi-character StringSplit is broken with Dataset ...
10
votes
2answers
135 views

Lookup with default broken in Dataset

Given an Association, ...
7
votes
2answers
187 views

Transpose can't handle fractions

Bug introduced in 10.0 and fixed in 10.2.0 Note: Dataset and Association are new in 10.0 Related to this question, why can't ...
4
votes
0answers
74 views

Why is Transpose Dataset slow in one direction

Transpose is faster when it distributes Keys at the 2nd level of a Dataset than when it factors them out. ...
4
votes
1answer
108 views

ANOVA test on dataset

I have a dataset with 3 groups and two variables. I want to do ANOVA test on the three groups for each variable. Does anyone know how to do this? ...
3
votes
0answers
51 views

Export to MX seems to corrupt the in-memory Dataset

I have a function that does a large number of calculations (by calling out to other smaller functions), and then builds a large Dataset object. Then I do two ...
11
votes
2answers
217 views

Simple way to concatenate Dataset columns

Consider these two datasets: d1 = Transpose@Dataset[<|"a" -> Range[5]|>]; d2 = Transpose@Dataset[<|"b" -> Range[5, 1, -1]|>]; {d1, d2} What's ...
1
vote
1answer
62 views

Plotting datasets using ErrorListPlot

I am trying to make list plots with the ErrorListPlot function. I have two datasets (ds1 and ds2) of which one plots nicely (ds1) and the other just give blank plots. I cannot see any difference in ...
2
votes
1answer
112 views

Applying a function to a column of a dataset [closed]

Functions can easily be applied to columns of datasets, as in the documentation it is shown. Now I want to apply a function with parameters to a column, but I get a list rules. E.g. ...
1
vote
1answer
47 views

Conditional Drop of a Key based on a test of the Value

I want to restructure a simple dataset. ...
3
votes
0answers
58 views

Applying functions to irregularly distributed Keys in Association lists

This Q is related to this one, but now refer to the situation as irregularly distributed Keys in lists of Associations: ...
2
votes
1answer
67 views

Applying Switch and Which to mixed-Key Association lists

Given an Association list w/ a common Key but also some distinct ones: ...
0
votes
1answer
94 views

A Query using Select and Quiet fails but Select by itself works

This is closely related to the question here, the key difference is that here data is structured as nested Association rather than a flat list: ...
0
votes
1answer
70 views

Dataset fails on StringMatchQ warning due to Missing value

Missing values are a pain mathematically and computationally in general not just in WL, but I think this problem is more related to Dataset handling of warnings: ...
0
votes
2answers
90 views

Is it possible to sum the results of a Map - Apply?

I am fairly new to functional programming and would like to replace a For[] loop that sums the results over a Dataset. This may be a bit different since the ...
1
vote
1answer
57 views
2
votes
1answer
52 views

Do Dataset functions get applied to rows in order?

If I have a dataset ds and perform an operation such as ds[All, f] does f get applied in the order the rows exist (the order they were placed into the dataset or as the result of a SortBy clause) or ...
1
vote
0answers
49 views

Multiplying two sets of data (x,y values, but different x density) followed by integration of the product

I've been trying to do this by myself today, but no luck yet. Please, see attached image. Basically, I do have two data sets A (x1,y1) and ...
12
votes
1answer
161 views

Dataset with more than 16 “columns”?

A Dataset with 16 columns or less is shown in a nice way: ...
7
votes
1answer
167 views

How would I use Map on a Dataset column?

I am somewhat new to functional programming. To improve the performance of a package, I would like to re-write a package in a functional style. I have the following ...
5
votes
2answers
109 views

Dataset Query using Composition fails but RightComposition works - why?

V10.1 on Win764 Enterprise. In this (CORRECTED) example the two Queries may be compounded into one using RightComposition sucessfully... ...
5
votes
2answers
199 views

Create a list of rules built from data set fields

I want to convert a dataset to a list of features and a list of target values, for use in Predict and also more generally. I know ...
17
votes
1answer
204 views

Why do lookup times in Dataset and Association differ by orders of magnitude?

Consider the following three data structures: a list of rules, an association, and a dataset: ...
0
votes
1answer
67 views

Need Query form to extract Min and Max DateList values for PlotRange from a Dataset

(* SUMMARY - In a Dataset holding DateList entries, how do I extract a minimum and maximum DateList value to pass into DateListPlot's PlotRange specification? See QUESTION further below *) (* Sample ...
4
votes
2answers
118 views

Apply an accumulative function to each column of a dataset

Given a dataset with many columns, how can apply a function (in this case Count[Missing_]) to each column? ...
10
votes
2answers
304 views

Why can I not replace a Dataset using a rule?

Simple replacement of a Dataset object does not seem to follow the expected behavior... Dataset[{}] /. _Dataset->1 Returns the empty Dataset not 1 as I would ...