Questions on systematic data handling and analysis, including data correction, manipulation, or selection of user-data or built-in data available with Mathematica.

learn more… | top users | synonyms

6
votes
2answers
522 views

Map of Swedish regions?

There have been some questions dealing with how to draw individual US states since such data doesn't come with Mathematica through its CountryData which offers ...
1
vote
1answer
85 views

Forcing contours to close at edge

I have some data that I am plotting with ListContourPlot and I would like my contours to be closed at the edge (closing around the high value region). A simple ...
3
votes
2answers
688 views

Removing trailing zeros from a list

If I have a list like list1={2334.,342.,0.,0.,2322.,0.,0.,0.,0.,,,,,,}; it's easy to remove to trailing blanks with ...
4
votes
4answers
586 views

More elegant way

I read ReplaceOrRemoveInvalidOrMissingData Mathematica documentation, and I tried to apply the same approach to my dataset. I've got two problems, but one is only a style problem! There is one more ...
8
votes
2answers
709 views

Correct fourier scaling and high-resolution frequency identification

I have a dataset of amplitude versus time $(t,A(t))$ and I need to extract the dominant frequency and amplitude, and also get the amplitude at one other specific frequency. My data looks like this: ...
4
votes
1answer
794 views

ReadList with header and foot lines

I want to do some large data analysis, and i want to be able to import files in a fast way. I tried Import, but it is quite slow; ReadList takes half the time. This is the code I was using: ...
0
votes
2answers
56 views

Filter through list and lump data [duplicate]

I have a very large data set (around 3000) that looks like: ...
1
vote
1answer
176 views

Exporting a list as RawData or Data

My problem is quite simple yet I do not seem to figure out the solution to it. I am simply trying to export a list in Mathematica, actually a list of lists of lists etc, something like ...
2
votes
2answers
192 views

Plotting data in a weird format

I have a lot of data on the following form: data = {{param1,param2,param3,param4,{{x1,y1},{x2,y2},...,{xn,yn}}},...} The first variables in each sublist are ...
1
vote
1answer
251 views

How to export data in scientific form

I am having an issue about how to export data in its scientific form using Mathematica. To be concrete, I define a list ...
2
votes
1answer
137 views

Represent more nested dataset with the same color in the PieChart

I have multiple dataset that I want to plot in PieChart, as in PieChart[{{2, 2}, {1, 2, 4}}, ChartLayout -> "Stacked"] Now here is the catch: I want the color ...
2
votes
0answers
753 views

histogram fit for probability density [closed]

I am trying to fit the (probability density) histogram of some data with the exponential function, but I am having difficulties. My raw data are in file called ...
3
votes
2answers
262 views

How to read non-standard-format data into Mathematica from a file

I would like to read non-standard-format data into Mathematica from a file. How can this be achieved? For example, how can I read the following text file of data into Mathematica: ...
3
votes
3answers
555 views

For-loop not working as I expect

I want to do this: When 10 <= t < 130, give t -> 1; When 130 <= t<300, give ...
1
vote
1answer
147 views

Find Numerical Derivatives (With Errors) given some data

I have a question. Suposse I have some data with their respective errors: ...
7
votes
1answer
258 views

Assign the contents of a “Copy” operation programmatically to a variable?

While an earlier question Cut and paste data from a spreadsheet nominally addresses the issue, a year has past since its OP asked it and I hope that others have come across simpler or more direct ...
3
votes
2answers
248 views

Multi-Fitting with Nonlinear model

I want to fit experimental data by the H-N model. Here is the H-N model: $$\text{EHN}(T)\text{=}\text{E$\infty $}+\frac{\text{E0}-\text{E$\infty $}}{\left(1+\left(i \omega\tau(T_g)10^{-\frac{\text{C1} ...
23
votes
5answers
2k views

Graph databases / Nosql with Mathematica

I am very new to mathematica but it looks like an interesting language and I would like to explore it for a future project to create a web search engine. It seems like it would be fairly well suited ...
19
votes
5answers
2k views

Moving maximum function?

How can I construct a moving maximum function? For example, if I have a list of 12 values: { 5, 6, 9, 3, 2, 6, 7, 8, 1, 1, 4, 7 } and I want to maximize over 3 ...
5
votes
3answers
387 views

Determing two Nonlinear model fits with 95% confidence bands from one data set

I have the following data which is postulated to have contributions from two different sources .....as can be seen from the confidence band, many points are out of the band. Question: How can I ...
4
votes
1answer
229 views

How to get an equivalent of WeightedData in Mathematica 8?

Is there an equivalent command of WeightedData (new in version 9) in Mathematica 8 or I have to define it by myself? I haven't found anything in the site or ...
2
votes
1answer
113 views

WeatherData function problem: “NonMetricValue” returns undated list of values

In the WL example below, WeatherData[] returns an undated list of values when I add the annotation "NonMetricValue." ...
4
votes
1answer
293 views

FindFit not giving a good fit despite good initial parameters

I'm having a problem with FindFit not giving a good fit to my data, even though the initial parameters I give look really good when plotted. The fitting function is ...
2
votes
0answers
66 views

How to save all variables in the workspace into a file? [duplicate]

I did some time consuming computation and obtained a lot of arrays and variables; however after restart the Mathematica Kernel, all these computational results disappeared. How can I save all these ...
12
votes
2answers
3k views

Finding fourier transform of data and hence frequencies

I looked at all the other questions related to mine before posting this, and they didn't solve my problem. I have a large data set which can be downloaded from here. I'm using the following code to ...
6
votes
1answer
751 views

Having trouble fitting data using NonlinearModelFit

I'm trying to fit data = {{2002, 45000}, {2004, 90000}, {2005, 120000}, {2013, 211000}}; to an exponential function ...
12
votes
2answers
1k views

Filtering and Replacing outliers

I have a set of data that measurements of temperature vs time (date). It is easy to realize when the sensor went wrong as one might see a blip on the data. How to teach to Mathematica to: 1) Detect ...
8
votes
1answer
256 views

How to reconstruct a missing data point

In the output of a large computer simulation(thousands of cpus for 3 days), I found that one data point is missing in the result. Is it possible to reconstruct the missing value using the remaining ...
2
votes
5answers
434 views

How do I find the maximum value from the given set of data?

I have a set of data like {{x1, y1},{x2, y2}, ...,{xn, yn}}. From this data can I find the value of x for which ...
2
votes
1answer
253 views

importing large data files with a constraint

As I have learned in this community, one way to import a hefty data files (e.g. millions of rows of {x1, y1} data) if you don't care about the individual elements (maybe just want to obtain some ...
0
votes
1answer
164 views

How to adjust the correct ImageSize between two plots

Let's consider the following simple plot ...
3
votes
1answer
166 views

I need a technique for determining and drawing a line where the density in a listplot jumps up suddenly

Basically I have a two dimensional list plot with a bunch of points between the square of (0,0) and (1,1). The y-values of these points are drawn from a uniform probability distribution between 0 and ...
2
votes
2answers
253 views

Need help in making a fit to my experimental data

This is what I have done so far. The points are of angles-of-deviation and wavelengths from my physics lab experiment. ...
1
vote
1answer
68 views

How to extract data beginning on the closest number to zero?

I have a list from which I want to extract only the values beginning from where b (from {a,b}) is the closest to zero. For example: I want extract data={{2, -0.036704}, {56.7499, 0.95489}, {73.7349, ...
1
vote
1answer
511 views

Need help with extracting columns from a table

I'm trying to clean a dataset of unnecessary variables but I constantly get an error when doing so. Following an example where: ...
6
votes
2answers
240 views

Implement planar correction for skewed 3D profilometric data

I have some data that represents small-scale surface topography. The data is planar but not flat because it's impractical to level this microscope to a tolerance of microns. It looks like this: I'd ...
2
votes
2answers
122 views

How to extract data depending on Position of First zero?

I have a file (attached as an image) which I imported to Mathematica and only extracted the first and second column. My problem is that I want to extract the data beginning from the row where $A=0$. ...
1
vote
0answers
44 views

How can I convert a matrix into matlab form string? [duplicate]

How can I convert a matrix into matlab form? ...
3
votes
2answers
365 views

How to delete all rows in datafile that contain a string

I'm importing some data from a file. However, the file was created by an unreliable instrument, such that the data looks like this: ...
2
votes
1answer
238 views

Read C-formatted hexadecimal numbers?

I have a lot of 32-bit numbers in hexadecimal symbolized as they are in C (for example, 0x1230abde). How can easily read these in Mathematica?
3
votes
2answers
262 views

Import numeric data into Mathematica

I have a C++ program that outputs a set of numbers at each time step. A blank line separates successive time steps. Here is an example of my data format: ...
3
votes
2answers
305 views

Selecting for 2D points that are within a threshold distance of an upper- and lower-bound number of points

I have a very large set of 2D points: numberOf2DPoints = 10^6; pointList = RandomReal[{0, 1000}, {numberOf2DPoints, 2}]; I'd like to find a way to quickly ...
1
vote
1answer
143 views

Reading between blank lines in external data files

I have an external data file with several columns and thousands lines of data. For the sake of this question, let's assume that we use ...
1
vote
2answers
102 views

Missing something in my input for CountryData dependencies

I'm trying to find (a)which countries have dependencies (b)and a list of countries that consider themselves dependencies (c)and a list of countries that don't consider themselves dependencies. ...
0
votes
1answer
163 views

Understanding distribution chart

How to explain DistributionChart function in mathematica, For example: if I have ...
3
votes
1answer
227 views

Judging the quality of fitting an EventData object to a distribution using LogRankTest

I have $389$ data points defined in an EventData object and want to judge the quality of fit of this data to a fitted $3$-parameter Weibull distribution. This ...
4
votes
1answer
227 views

How to Use ProbabilityScalePlot with Censored Data?

I am trying to reproduce a ProbabilityScalePlot of censored data shown here (see Sample Analysis Plot). Here is my Mathematica code. First I deal with the uncensored case. ...
7
votes
1answer
112 views

Why does Rescale performance vary significantly based on the real number values in a list?

I have a list of the form: testList = Table[{Flatten[RandomReal[{-200, 200}, {1, 2}], 1], RandomReal[{-200, 200}, {69, 2}]}, {i, 1, 100}]; And I would like to ...
5
votes
2answers
489 views

How to exclude some points to make them more evenly distributed in a figure

If there are some points in a figure, how can I exclude some points to make them more evenly in the figure? 'Evenly' here can be defined as the number of points in each $0.01*0.01$ box is at most one. ...
10
votes
5answers
805 views

Relational joining of tables

A common thing to want to do with data is to combine it (at least I thought this was a common thing). In SQL there is the idea of table joins "select id,v1,v2 from A,B where A.id=B.id" kind of thing. ...