0
$\begingroup$

I am working on a Design of Experiments to determine the image adjustment settings for a given collection of aircraft images to maximize the probabilities of correctly identifying the aircraft types using ImageIdentify.

The > Neat Example for ImageIdentify in the documentation shows the use of a category Entity["Word", "car"].

When I use Entity["Word", "aircraft"], the identification is by broad aircraft type. I would like the probabilities by the entries in AircraftData[] so that I could see the probability that the image is an F-15 Eagle, F/A-18 Hornet, etc.

ImageIdentify[f15image, Entity["Word", "aircraft"],10, "Probability"]

Returns

<|Entity["Concept", "Interceptor::zff3s"] -> 0.74917, 
 Entity["Concept", "AttackAircraft::548v5"] -> 0.755533, 
 Entity["Concept", "StealthFighter::54q24"] -> 0.00636256, 
 Entity["Concept", "MilitaryPlane::whx2r"] -> 0.75629, 
 Entity["Concept", "Aeroplane::239dv"] -> 0.999771, 
 Entity["Concept", "JumboJet::558sx"] -> 0.12094, 
 Entity["Concept", "Floatplane::5wd4t"] -> 0.0944084, 
 Entity["Concept", "Jetliner::p464v"] -> 0.0241423, 
 Entity["Concept", "FlyingBoat::t75c7"] -> 0.00215588, 
 Entity["Concept", "JetPlane::q8z95"] -> 0.145083|>

I would like to use ImageIdentify with AircraftData[] or EntityList["Aircraft"] to see if it can identify specific aircraft types. None of my attempts to date have succeeded.

ImageIdentify[F15, Entity["Aircraft"], 10, "Probability"]

Returns

Entity["Aircraft"] is not a valid object.
  • I am working through the article on Resolving my Entity Crisis.

  • A hierarchical diagram that shows the relationships between the Entity... functions and terminology would be most helpful.

Do I need to create a custom entity store to make this possible?

$\endgroup$
4
  • 1
    $\begingroup$ Have you seen this question: Why does ImageRecognition recognise some concepts in a list of concepts but not others? ImageIdentify uses a pretrained neural network to give predictions from a preset list of entities/concepts. If you want to include more of them, you have to train your own neural network with relevant image examples. $\endgroup$
    – Domen
    Commented Mar 22, 2023 at 17:43
  • $\begingroup$ I think that is part of it. I need to dig into the Entity... functions and terminology. This is not intuitive. I am sure that I will need to train my own neural network using Janes and other sources. What is here is neat to a point - but not to the level that I need. $\endgroup$ Commented Mar 22, 2023 at 18:23
  • $\begingroup$ So I assume you already have a large annotated collection of aircraft images? In that case, you can simply use Classify on this set of data, and you will get a classifier which you can then use on other, unannotated images. $\endgroup$
    – Domen
    Commented Mar 22, 2023 at 20:15
  • $\begingroup$ I will experiment with Classify. I may try to use the Name and Image properties of AircraftData[]. Barring that I will use a database of aircraft types. $\endgroup$ Commented Mar 23, 2023 at 10:24

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.