Dear Mark12Ding:
When I'm reading your code,which is "obj_ptrs = self.obj_ptr_proj(sam_output_tokens)". your idea is puting obj_ptrs into memory.But in original sam2 code,the module which is "obj_ptr = self.obj_ptr_proj(sam_output_token)",is not been trained.the evidence is " all_frame_outputs = [{k: v for k, v in d.items() if k != "obj_ptr"} for d in all_frame_outputs ]" in sam2.py,which in original sam2.
it means that all related to this module is not been trained.So,in my opinion,‘self.obj_ptr_proj’ can not output right values.