Login
Password
Sources on this Page

> Headlines by Category

 Home / Science / Mathematics

You are using the plain HTML view, switch to advanced view for a more complete experience.

Programmable droplets' could enable high-volume biology experiments
Researchers have developed hardware that uses electric fields to move droplets of chemical or biological solutions around a surface, mixing them in ways that could be used to test thousands of reactions in parallel.
Piecework at the nano assembly line
Scientists have developed a novel electric propulsion technology for nanorobots. It allows molecular machines to move a hundred thousand times faster than with the biochemical processes used to date. This makes nanobots fast enough to do assembly line work in molecular factories.
Let's make a deal: Could AI compromise better than humans?
Researchers developed an algorithm that teaches machines not just to win games, but to cooperate and compromise -- and sometimes do a little trash-talking too.
Ugly Data App

Richard is a Consultant at MathWorks focused on the Embedded Coder product for code generation, primarily in the Aerospace
industry.

Richard’s pick this week is Ugly Data App by Adam Sifounakis.

Contents

Pick

My pick this week is Ugly Data App – a tool to clean up data .

This submission is a great example of the types of complex User Interfaces that can be created using MATLAB’s App Designer.
The tool itself allows the user to bring in data from the MATLAB workspace and then operate on it in a number of ways.

The first option is to handle missing values. The user can specify how the missing data should be handled by selecting a
fill method from the list such as Linear or Spline. The tool also allows the user to constrain the data by specifying thresholds
at which the data will be replaced with NaNs. As an example, the data may only be valid for values greater than zero. This
allows you to eliminate those erroneous data points.

The next option is to handle any outliers in the data. The user can specify the outlier method to use from a list and the
corresponding parameters associated with the method such as the threshold factor. The plot is updated to show the boundaries
of the outliers. Similar to the Missing Data, the user can specify a fill method for the outliers from a list.

The third option allows the user to smooth the data. The smoothing method can be selected from a list and the smoothing parameters
set.

Once the data has been “cleaned”, it can be exported to either MATLAB’s Workspace or to an Excel file via the “Export Data”
menu item. There are also menu items to specify “Plot Options”, provide “Feedback” to Adam, and to get “Help” for the App.

However, the feature of this App that sets it apart is the ability to “Generate Code”. This menu item allows the user to
automatically create a MATLAB script or function that performs the same steps. This allows the user to “set-up” the data
cleaning once, and then easily apply it to as many data sets as desired. The resulting MATLAB code follows the same steps
that the user did manually. As such, the user needs to keep this in mind when working with the data. You probably don’t
want to insert NaNs after having filled the NaNs. The order of the steps can be seen in the lower left corner in the “Code
Generation” box.

Enhancements

There are some enhancements that I would like to see Adam make to this App:

  • Provide “zoom” capability on the plot to allow the user to focus in on a section of the data.
  • Provide more documentation on the usage of the App. A set of examples highlighting the capabilities would be beneficial.
  • Provide an option to show a subplot of the difference between the original data and the adjusted data.
  • Insert a marker for any NaNs found in the raw data and not just those that are byproducts of setting boundaries.

Comments

As stated before, this is a great example of the custom User Interfaces you can build in MATLAB. If you have test data that
contains dropouts or outliers, this App allows you to manually adjust the data. However, the real benefit is the ability
to then create a custom MATLAB script/function to perform the same adjustments – which allows it to be applied to many sets
of data. Give it a try and let us know what you think here or leave a message for Adam.

Get
the MATLAB code

Published with MATLAB® R2017b

Using data mining to make sense of climate change
Experts have developed a new way of mining data from climate data sets that is more self-contained than traditional tools. The methodology brings out commonalities of data sets without as much expertise from the user, allowing scientists to trust the data and get more robust -- and transparent -- results.
A centuries-old math equation used to solve a modern-day genetics challenge
Researchers developed a new mathematical tool to validate and improve methods used by medical professionals to interpret results from clinical genetic tests.
Building blocks to create metamaterials
Engineers have created a method to systematically design metamaterials using principles of quantum mechanics.
From healthcare to warfare: How to regulate brain technology
Ethicists have outlined a new biosecurity framework specific to neurotechnology. While the researchers declare an outright ban of dual-use technology ethically unjustified, they call for regulations aimed at protecting the mental privacy and integrity of humans.
Using electricity to switch magnetism
Scientists have managed to use electrical fields to control the magnetic oscillations of certain ferrous materials. This has opened up huge potential for computer technology applications, as data is currently transferred in the form of electrical signals but stored magnetically.
AI 'scientist' finds that toothpaste ingredient may help fight drug-resistant malaria
An ingredient commonly found in toothpaste could be employed as an anti-malarial drug against strains of malaria parasite that have grown resistant to one of the currently used drugs. This discovery was aided by Eve, an artificially intelligent 'robot scientist.
Post Selected Items to:

Showing 10 items of 140

home  •   advertising  •   terms of service  •   privacy  •   about us  •   contact us  •   press release design by Popshop •   © 1999-2018 NewsKnowledge