question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Heatmaps Do not look as expexted????

See original GitHub issue

Hello,

I have trained ROMP on the pw3d dataset for 150 epochs and from SCRATCH. Here are my hyperparameters:

ARGS:
 tab: 'V1_hrnet' 
 dataset: 'pw3d'
 GPUS: 0,1,2,3
 distributed_training: False
 model_version: 1
 match_preds_to_gts_for_supervision: True

 master_batch_size: -1
 val_batch_size: 16
 batch_size: 16
 epoch: 150
 nw: 4
 nw_eval: 2
 lr: 0.00005
 exp: 'ROMP'              # experiment name
 save_dir: './results'           # Path to results directory

 fine_tune: True
 fix_backbone_training_scratch: False
 eval: True
 supervise_global_rot: False

 model_return_loss: True
 collision_aware_centermap: True
 collision_factor: 0.2
 homogenize_pose_space: True
 shuffle_crop_mode: True
 shuffle_crop_ratio_2d: 0.1
 shuffle_crop_ratio_3d: 0.4

 merge_smpl_camera_head: False
 head_block_num: 2

 backbone: 'hrnet'
 centermap_size: 64
 centermap_conf_thresh: 0.2

 model_path: None

loss_weight:
 MPJPE: 200.
 PAMPJPE: 360.
 P_KP2D: 400.
 Pose: 80.
 Shape: 6.
 Prior: 1.6
 CenterMap: 160.

sample_prob:
 pw3d: 1

The model seems to be well converged and here is the loss function: Screen Shot 2022-07-19 at 5 29 03 PM

However, when I look at the Center-map heatmaps it doe Screen Shot 2022-07-19 at 5 27 16 PM s not look good at all:

I expected to get a plot similar to below that I obtained by fine-tuning the ROMP with HRNet-32 as the backbone (V1_hrnet_3dpwft.sh): Screen Shot 2022-07-15 at 4 52 37 PM

Any thought or advice on why this is the case and what I further need to do to improve the center map heatmap?

Thanks in advance,

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:7 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
Arthur151commented, Aug 2, 2022

Hi, really sorry about that I missed this issue.

The 2D pose and body center heatmap are estimated by two individual heads. We need to supervise the estimated body center heatmap with the ground truth heatmap We calculate the ground truth body center location in heatmap using the ground truth 2d pose for supervising the estimated body center heatmap. The reason why we also use an individual head to estimate 2D pose heatmaps is that previous research (Taskonomy, best paper of cvpr18) testified that learning from related task is helpful for better representation learning. And we find that it is an important part to learn in the pretraining process.Thanks for your interests in ROMP.

0reactions
mkhoshlecommented, Aug 1, 2022

@Arthur151 Nice. Thanks so much.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Heat mapping not showing all areas expected
Solved: Hi, using power bi map visual and have switched on heat maps toggle and some areas doesn't show at all despite company...
Read more >
A Complete Guide to Heatmaps | Tutorial by Chartio
Heatmaps take the form of a grid of colored squares, where colors correspond with cell value. This article will show you how to...
Read more >
What's wrong with (Click) Heat Maps? | UseItBetter Blog
The heat map of visitors who failed shows that the visitors failed regardless whether they tried to sign in or register. But can...
Read more >
Did You Know that Heat maps aren't Hot-Spot maps? I didn't.
To prove that our clusters are not random. Hot spot maps are meant to show the level of variance from an area's expected...
Read more >
What is a Heat Map, How to Create One, Examples and Case ...
A heat map is data analysis software that uses color the way a bar graph uses height and width: as a data visualization...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found