Skip to content

Conversation

@nohayassin
Copy link
Contributor

Adding Tensorflow wrapper.
Track on: DSO-15262

@ev-mp ev-mp mentioned this pull request Oct 4, 2020
@nohayassin nohayassin changed the base branch from master to development October 4, 2020 11:08
Copy link
Contributor

@ev-mp ev-mp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done - several cosmetic fixes

feed_dict={image_tensor: image_expanded})
```

Finally we will assign random persistent color to each detection class and draw a bounding box around the object. We filter out low confidence predictions using `score` output.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Finally,

verts = np.asanyarray(points.get_vertices()).view(np.float32).reshape(-1, W, 3) # xyz
```

This allows us to query XYZ coordinates of each detected object and to seperate individual coordinates (in meters):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

separate


## Part 3 - Deploying TensorFlow model using OpenCV

While TensorFlow is convinient to install and use, it is not as convinient as OpenCV. OpenCV is ported to most platforms and is well optimised for various types of CPUs. It also comes with built-in DNN module capable of loading and using TensorFlow models without having TensorFlow (or its dependencies) installed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

convenient

Unet offers significant advantages compared to classic autoencoder architecture, improving edge fidelity (see image below).

![foxdemo](images/Unet.PNG)
###### The image is taken from the article reffered above.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

referred

very good at detecting more and more features, the first few layers of a convolution network capture a very small semantic information and lower level
features, as you go down these features become larger and larger, but when we throw away information the CNN
knows only approximate location about where those features are.
When we upsample we get the lost information back (by the concatination process)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

concatenation

#### Data Augmentation
To help the neural network learning image features we decide to crop input images into tiles of 128x128 pixels.

Each ground truth image has a corressponding depth and infrared image. Given that, the dataset is augmented as following:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

corresponding

Copy link
Contributor

@ev-mp ev-mp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done!

@ev-mp ev-mp merged commit 86967a1 into realsenseai:development Oct 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants