Questions tagged [testing-and-verification]

Questions about creating, maintaining, and verifying tests for functions and packages. This includes doing unit tests, creating testing notebooks, running verification tests, generating test reports, and using the MUnit package.

12 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
11
votes
0answers
138 views

Continuous integration (CI, software development) with Wolfram Language?

Continuous integration (in the software engineering sense) is a common method to ensure that the code in your repository works as it should after each commit. For example, you can run a set of ...
6
votes
0answers
106 views

Testing Grids in a Testing Notebook

I have an issue testing functions that generate formatted output. For example: 1) Create a new testing notebook and a new test like this: 2) Now execute the test (it fails as expected) 3) Now click ...
5
votes
0answers
88 views

Problems with Failure in Testing Notebooks

This always fails the test: Failure["General", <|"MessageTemplate" -> "`1`", "MessageParameters" -> {foo}|>] While this passes as expected: ...
5
votes
0answers
333 views

How can I run MUnit tests outside of Workbench under Linux?

I would like to run MUnit tests from the command line. On Mac OS, I can do this: ...
4
votes
0answers
53 views

Testing packages against old Mathematica versions

I've made a Mathematica package available, and it's been reported to me that it doesn't work with Mathematica 4. I've guessed at some of the issues, and provided work arounds, but that process is ...
4
votes
0answers
267 views

Debugging Test files generates exception in Workbench 2 and 3

I'm having trouble running the "test file" example given in the video here http://www.wolfram.com/broadcast/screencasts/workbench/WorkbenchTesterDemo/ in "Debug As...". RUNning the test file "test....
1
vote
0answers
38 views

How can I launch GenerateDocument with a template file on multiple kernels in a batch fashion?

I am trying to do automated testing of my MMA package by launching test cases that are generated on-the-fly with GenerateDocument and a template document, and then evaluated with NotebookEvaluate. I ...
1
vote
0answers
76 views

Testing Notebook fails on Datasets

I have some functions that read in a .csv and convert them to a Dataset, and do some processing. I've written tests to validate that the correct transformations occur (so far very simple...like ...
1
vote
0answers
154 views

Check, Quiet and VerificationTest with messages?

I have a VerificationTest that is expected to generate some messages. It runs inside of code that uses Check to ...
1
vote
0answers
42 views

Possible bug with Testing Notebook & messages x::y where x has an OwnValue

I think this should be considered a bug (or at least an inconvenience) and should be reported: Say you have some code generating the $RecursionLimit::reclim2 ...
1
vote
0answers
121 views

Software Testing (Dynamic, Manipulate, DynamicModule) Interfaces

The main Testing Framework (in both the frontend and Wolfram Workbench) supports unit testing for command-line invocations. Is there a natural way of co-opting this, or perhaps there already exist ...
0
votes
0answers
44 views

How to use === with condition?

I have two expressions, and they are same when k is positive and x is non-zero real number. Below code gives me ...