-wd method not working

[Phoenix1112]

I am using the -wd parameter to clean wildcard subdomains with the latest version, but it does not produce any results.

root@localhost:~/deneme# cat domains
tk.octopus.energy
status.electroverse.octopus.energy
octopus.energy
asasasas.octopus.energy
555asasasas.octopus.energy
root@localhost:~/deneme#
root@localhost:~/deneme#
root@localhost:~/deneme# dnsx -l domains -wd octopus.energy

      _             __  __
   __| | _ __   ___ \ \/ /
  / _' || '_ \ / __| \  /
 | (_| || | | |\__ \ /  \
  \__,_||_| |_||___//_/\_\

                projectdiscovery.io

[INF] Current dnsx version 1.2.2 (latest)
Starting to filter wildcard subdomains
0 wildcard subdomains removed
root@localhost:~/deneme#

The following subdomain addresses have the same IP address, but they still do not respond.

octopus.energy
asasasas.octopus.energy
555asasasas.octopus.energy

[forghani77]

True, having the same issue

[Phoenix1112]

İ installed 1.2.1 version again

[jjhwan-h]

hi team
I looked into the issue and found that the problem was caused by the unmarshal below, so I tried to fix it. Can I open a PR for this?

# runner.go
if r.options.WildcardDomain != "" {
    gologger.Print().Msgf("Starting to filter wildcard subdomains\n")
    ipDomain := make(map[string]map[string]struct{})
    listIPs := []string{}
    // prepare in-memory structure similarly to shuffledns
    r.hm.Scan(func(k, v []byte) error {
        var dnsdata retryabledns.DNSData
        if err := json.Unmarshal(v, &dnsdata); err != nil {
            // the item has no record - ignore
            log.Println(err)
            return nil
        }

        for _, a := range dnsdata.A {
            _, ok := ipDomain[a]
            log.Println(a)
            if !ok {
                ipDomain[a] = make(map[string]struct{})
                listIPs = append(listIPs, a)
            }
            ipDomain[a][string(k)] = struct{}{}
        }

        return nil
    })

    gologger.Debug().Msgf("Found %d unique IPs:%s\n", len(listIPs), strings.Join(listIPs, ", "))
    // wildcard workers
    numThreads := r.options.Threads
    if numThreads > len(listIPs) {
        numThreads = len(listIPs)
    }
    for i := 0; i < numThreads; i++ {
        r.wgwildcardworker.Add(1)
        go r.wildcardWorker()
    }

numThreads := r.options.Threads
if numThreads > len(listIPs) {
    numThreads = len(listIPs)
}

• numThreads is reset from the default 100 to 0 (because it’s set to len(listIPs)).
• r.hm.Scan is not appending; listIPs is not being populated.

r.hm.Scan(func(k, v []byte) error {
    var dnsdata retryabledns.DNSData
    if err := json.Unmarshal(v, &dnsdata); err != nil {
        // the item has no record - ignore
        log.Println(err)
        return nil
    }

• When printing err, it shows that unmarshalling fails.
  2025/09/12 01:24:20 json: cannot unmarshal object into Go struct field Msg.raw_resp.Answer of type dns.RR

func (r *Runner) storeDNSData(dnsdata *retryabledns.DNSData) error {
	dnsdata.RawResp = nil

	data, err := dnsdata.JSON()
	if err != nil {
		return err
	}
	return r.hm.Set(dnsdata.Host, []byte(data))
}

• set RawResp to nil before JSON marshal

result

 ./dnsx -l test.txt -wd octopus.energy -wt 1

      _             __  __
   __| | _ __   ___ \ \/ /
  / _' || '_ \ / __| \  / 
 | (_| || | | |\__ \ /  \ 
  \__,_||_| |_||___//_/\_\

                projectdiscovery.io

[INF] Current dnsx version 1.2.2 (latest)
Starting to filter wildcard subdomains
octopus.energy
status.electroverse.octopus.energy
tk.octopus.energy
2 wildcard subdomains removed

[dwisiswant0]

Can I open a PR for this?

Feel free.

[Mzack9999]

Fixed in PR #903.