Questions on systematic data handling and analysis, including data correction, manipulation, or selection of user-data or built-in data available with Mathematica.

learn more… | top users | synonyms

0
votes
1answer
16 views

Applying the mathematical formula upon all files

I am calculating the depth data exist in .log file type, The depth data is like this I did it by means of mathematica: ...
1
vote
1answer
21 views

Do Any of the filter functions perform a LOESS or LOWESS filter?

From the Data Transforms and Smoothing guide there is a link to the Linear and Nonlinear Filters guide. Do any of these filter functions perform a LOESS or LOWESS filter on set of paired data? ...
9
votes
1answer
92 views

How to do Independent Component Analysis?

The new experimental function in 10.3.1 DimensionReduce[], has the following three options for Method: ...
0
votes
1answer
25 views

How to visualize .data files?

I am working with simulation models trying to carrying out some predictions in ocean waves and this stuff. (MITgcm) I am able to run the program and generate output .data files, but i don't know how ...
0
votes
1answer
44 views

Interpolate the discrete list into continuous function

I have a data whose list plot shows up following graph I would like to interpolate the missing data and make the function continuous but for particular x-coordinate there is multiple values of $y$ ...
16
votes
3answers
714 views

Export dataset to JSON including Unicode Characters

I'm experiencing a weird issue. Consider a dataset defined like this: dataset = Dataset[{<|"a" -> 1, "b" -> 2|>, <|"a" -> 3, "b" -> 4|>}]; ...
3
votes
1answer
30 views

Spacing control in export

While using, for example, the code ...
19
votes
3answers
480 views

Detecting components in timeseries

I'm looking at this sequence of values: I'd like to detect the points where the center of the time-series shifts (around x=1000 and x=2000). Many of the transforms and smoothing methods I have ...
3
votes
0answers
79 views

WDF specification?

Motivated by a recent question on the meaning of all sorts of W* acronyms, I would like to get more information about the Wolfram Data Framework (WDF). On its web page ...
12
votes
1answer
210 views

How does Dataset compare to DataFrame in pandas?

Pandas is a Python package providing fast, flexible, and expressive data structures designed to make working with “relational” or “labeled” data. Just like ...
1
vote
1answer
40 views

How to export data from ListLogLogPlot [closed]

I have a ListLogLogPlot, for example: data1 = ListLogLogPlot[Table[{i^2, i^(1/3)}, {i, 1, 20, 1}]] Note: I know that there is ...
6
votes
4answers
243 views

Average dataset with many repetitions?

I have a dataset where each item is of the form: <|"p1" -> x1, "p2" -> x2, "r1" -> y1, "r2" -> y2|> The interpretation is this: ...
2
votes
1answer
48 views

Fitting data in Log-Log scale

I want to fit my data from a txt file to a curve in log-log scale. What I tried to do was this: ...
1
vote
1answer
34 views

Convert table data to Classifier data

I want to convert excel data into Classifier acceptable data. For Eg, the inbuilt Titanic data for Classifier is structured as below: {"1st", 29., "female"} -> "survived" I have 4 columns in ...
4
votes
0answers
85 views

Fitting data with unique variable per measurement

Imagine we are in the following situation, we have a nonlinear system of functions $f$ with coördinates $x_i$, and unknown parameters $\delta_i$'s and $t$. Let this system be defined as, ...
4
votes
3answers
225 views

Histogram of a very large dataset?

I have a very large dataset stored in a file (over 2GB). The file contains a tab-separated table of floating-point numbers. I want to do an Histogram of all the numbers in the table. But if I try to ...
1
vote
1answer
68 views
3
votes
1answer
96 views

How to plot data with domain on a circle?

I've got a list of data of the form {{0,x0},...,{359,x359}}, which represents some experimental results given in polar coordinates with fixed radius. How to plot ...
23
votes
5answers
2k views

Graph databases / Nosql with Mathematica

I am very new to mathematica but it looks like an interesting language and I would like to explore it for a future project to create a web search engine. It seems like it would be fairly well suited ...
0
votes
1answer
83 views

Manipulate a graph from data

I want to manipulate some data, to do this i create a graph. But i don´t know how to manipulate the data. ...
3
votes
1answer
100 views

Why is TimeSeriesForecast linear?

When I use FinancialData with TimeSeriesForecast, the resulting graph is always linear and thus not very accurate. ...
6
votes
2answers
522 views

Map of Swedish regions?

There have been some questions dealing with how to draw individual US states since such data doesn't come with Mathematica through its CountryData which offers ...
0
votes
1answer
72 views

FindFit and log norm function

I'm trying to fit a function to data using FindFit, but I can't find a way to replace norm function RMSE with a RMSE in log space: ...
1
vote
0answers
55 views

Convert large KML coordinate datasets to UTM [closed]

I was wondering if there are ways to convert massive amounts of KML coordinates into UTM coordinates using Mathematica. Other programs would also be acceptable. Thanks. I have the KML file from ...
0
votes
0answers
60 views

Problem with BSplineCurve 3D

I have a problem using the function BSplineCurve [ ] . I have to represent a line passing through about 3000 points in 3D. I managed to plot the points separately, but when I use the 3D BSplineCurve ...
5
votes
2answers
316 views

DistributionFitTest with WeightedData?

My problem is related to statistical testing with weighted data. I have a data sample and I assume that a part of the data follows a specific distribution (Pareto). So I fit my data to a distribution ...
12
votes
1answer
310 views

Integration of incomplete rings (ellipses) pattern

I am facing a problem in trying to do a series of averages in incomplete images. I have a series of X-ray data images, like this one: As you can see my image is a series of partial rings/ellipses ...
1
vote
0answers
56 views

How can I access the Criterion function of KI method in `FindThreshold` for a dataset?

I want to find a threshold for some data set, using Kittler-Illingworth minimum error thresholding method (KI method). To do so, I use the Mathematica built-in function ...
7
votes
1answer
94 views

Why some GeoProjections show just half of Chukotka region (Russian map)

I've moved to V.10.3 as suggested and proceed with Russian map (the aim is to geoplot regional distributions of some values). Notice most eastern Russian region - Chukotka. Chukotka, unlike other ...
2
votes
2answers
81 views

How to created visualization dashboard for summary data?

I would like to create the following dashboard: The numbers indicate my desired dimensions for the cells. I would like the cells to contain a regional plot, a trend line, and bar charts. I have ...
1
vote
1answer
87 views

Find intersections points with axes

Let's create some points corresponding to a simple closed curve ...
4
votes
0answers
60 views

File Formats for Scientific Data

I have a simulation written in another language which currently just dumps all its data (doubles, lists of doubles, lists of lists of doubles) in lines in ASCII, and then I read it into Mathematica by ...
3
votes
1answer
79 views

How to normalize histogram height to unity?

When doing Histogram[data], I get the total nummber of counts in each bin. Doing Histogram[data,Automatic,"Probability"] ...
1
vote
2answers
118 views

Handling big data in Mathematica 10 [closed]

I have a huge amount of data saved in a .txt file (153 MB, ~7300000 rows). What I want in the end is a list like ...
1
vote
2answers
98 views

depicting specific element of a table (knowing its position) in different color

there is some 20 Time 20 tables, in each step we choose one element randomly. how can show this random selected element with different color?
8
votes
2answers
708 views

Correct fourier scaling and high-resolution frequency identification

I have a dataset of amplitude versus time $(t,A(t))$ and I need to extract the dominant frequency and amplitude, and also get the amplitude at one other specific frequency. My data looks like this: ...
4
votes
2answers
90 views

Parsing tab delimited file

Problem Description I have my data arranged in a tab delimited file and I'm trying to parse/access certain parts of it. As an example, I'd like to extract the number of points and the sampling ...
2
votes
2answers
82 views

Plotting cones from data read from a file

I would like to plot cones centered at specific points in a lattice and with different orientations and colors that depend on them. For this, I have the data in an external file with 11 columns: 1) ...
1
vote
1answer
108 views

Fitting multiple peaks

I am using the code found here to fit multiple peaks of a large dataset which I don't know anything about. This was the only code I could find on the internet to do such a thing. So this is my attempt ...
5
votes
3answers
200 views

Removing background from peak function

Let's say I have a a very large list of data in the format {{n,f[n]}} so something like {{1,600},{2,700},{3,1100}...} and if this data is plotted, then it will look like a sum of Gaussian functions+a ...
0
votes
1answer
103 views

How to fit multiple Gaussian peaks to data [duplicate]

How would I fit this data with Gaussian Peaks? I have tried various codes but none have even worked. Note: If I do Log[data], the peaks are more visible (I have tried the method from here but it got ...
0
votes
0answers
20 views

Remove background from multipeak data [duplicate]

Let's say I have a a very large list of data in the format {{n,f[n]}} so something like {{1,600},{2,700},{3,1100}...} and if this data is plotted, then it will look like a sum of Gaussian functions+a ...
3
votes
0answers
89 views

Data smoothing in three dimensions

I have data with statistical fluctuations of the form $f(x_i,y_i)$ over a discrete grid. I now need the values of $f(x,y)$ also at points other than the grid points. That can be achieved by ...
2
votes
1answer
102 views

Collecting Data in table

I wrote a program (with help of the stackexchange) that is supposed to run in a loop. Each time the program runs, it exports a small data. Is it possible to generate a table where each run adds the ...
28
votes
1answer
559 views

Visual representation of a Ranking over time (image provided)

[Disclaimer: I initially posted this question on stackOverflow 2 months ago and think it might be better suited for this forum (link to original question)] The graph below shows a ranking of ...
2
votes
3answers
125 views

Making large calculation results persistent

Very often, I need to do same calculations under different parameters for comparing the results. Every calculation may generate a large data set; for example, the calculation result of ...
2
votes
1answer
80 views

simple contour plot with variable thickness

I have a data set on the form of 3 spatial coordinates x,y,z and an amplitude. Here is a small crop of the data, : ...
0
votes
1answer
54 views

How to import columns of data (.mat file)

I have a two 100x2 .mat file and I would like to get the elements stored as pairwise entries i.e. something like data = [{a1,b1},{a2,b2}..{a100,b100}]. Can someone help me do this efficiently?