* Change config.toml, Auto-generate UUIDs, change structure of optional field * Detect processes affected by update using yum-ps (#482) Detect processes affected by update using yum-ps * Detect processes needs restart using checkrestart on Debian and Ubuntu. * pass cpename by args when calling FillCveInfo (#513) * fix new db (#502) * Include Version,Revision in JSON * Include hostname in JSON * Update goval-dictionary's commit hash in Gopkg.lock * Remove README.ja.md * update packages (#596) * fix: change ControlPath to .vuls of SSH option (#618) * feat: checkrestart for Ubuntu and Debian (#622) * feat: checkrestart for Ubuntu and Debian * fix: dependencies check logic of configtest * feat: need-restarting on RedHat * refactor: Process.ProcName to Process.Name * feat: detect a systemd service name of need-restarting-process * feat: detect a systemd service name of need-restarting-process on Ubuntu * feat: fill a service name of need-restarting-process, init-system * Support NVD JSON and CVSS3 of JVN (#605) * fix: compile errors * fix: Show CVSS3 on TUI * fix: test cases * fix: Avoid null in JSON * Fix maxCvssScore (#621) * Fix maxCvssScore * Update vulninfos.go * fix(init): remove unnecessary log initialization * refactor(nvd): use only json feed if exists json data. if not, use xml feed * fix(scan): make Confidence slice * feat(CWE): Display CWE name to TUI * feat(cwe): import CWE defs in Japanese * feat(cwe): add OWASP Top 10 ranking to CWE if applicable * feat(scan): add -fast-root mode, implement scan/amazon.go * refactor(const): change const name JVN to Jvn * feat(scan): add -fast-root mode, implement scan/centos.go * refactor(dep): update deps * fix(amazon): deps check * feat(scan): add -fast-root mode, implement scan/rhel.go * feat(scan): add -fast-root mode, implement scan/oracle.go * fix complile err * feat(scan): add -fast-root mode, implement scan/debian.go * fix testcase * fix(amazon): scan using yum * fix(configtest): change error message, status when no scannnable servers * Fix(scan): detect init process logic * fix(tui): display cvss as table format * fix(scan): parse a output of reboot-notifier on CentOS6.9 * fix(tui): don't display score, vector when score is zero * fix(scan): add -offline mode to suse scanner * fix(scan): fix help message * feat(scan): enable to define scan mode for each servers in config.toml #510 * refactor(config): chagne cpeNames to cpeURIs * refactor(config): change dependencyCheckXMLPath to owaspDCXMLPath * fix(config): containers -> containersIncluded, Excluded, containerType * feature(report): enable to define cpeURIs for each contaner * feature(report): enable to specify owasp dc xml path for each container * fix(discover): fix a template displayed at the end of discover * feature(report): add ignorePkgsRegexp #665 * feature(report): enable to define ignoreCves for each container #666 * fix(report): Displayed nothing in TUI detail area when CweID is nil * Gopkg.toml diet * feat(server): support server mode (#678) * feat(server): support server mode * Lock go version * Use the latest kernel release among the installed release when the running kernel release is unknown * Add TestViaHTTP * Set logger to go-cve-dictionary client * Add -to-localfile * Add -to-http option to report * Load -to-http conf from config.toml * Support gost (#676) * feat(gost): Support RedHat API * feat(gost): Support Debian Security Tracker * feat(db): display error msg when SQLite3 is locked at the beginning of reporting. * feat(gost): TUI * Only use RedHat information of installed packages * feat(tui): show mitigation on TUI * feat(gost): support redis backend * fix test case * fix nil pointer when db is nil * fix(gost): detect vulns of src packages for Debian * feat(gost): implement redis backend for gost redhat api * feat(report): display fixState of unfixed pkgs * fix(report): display distincted cweIDs * feat(slack): display gost info * feat(slack): display mitigation * feat(report): display available patch state as fixed/total * fix(tui): display - if source of reference is empty * update deps * fix(report): key in ScanResult JSON be lowerCamelcase. * some keys to lower camel * fix(configtest): dep check logic of yum-plugin-ps * fix(tui): format * feat(report): add -format-list option * fix(report): -format-full-text * fix(report): report -format-full-text * fix(report): display v3 score detected by gost * fix(scan): scan in fast mode if not defined in config.toml * fix(gost): fetch RedHat data for fixed CVEs * feat(report): show number of cves detected in each database * fix(report): show new version as `Unknown` in offline and fast scan mode * fix(report): fix num of upadtable and fixed * fix(report): set `Not fixed yet` if packageStatus is empty * refact(gost): make convertToModel public * fix(test): fix test case * update deps * fix(report): include gost score in MaxCvssScore * [WIP] feat(config): enable to set options in config.toml instead of cmd opt (#690) * feat(config): enable to set options in config.toml instead of cmd opt * fix(config): change Conf.Report.Slack to Conf.Slack * fix(discover): change tempalte * fix(report): fix config.toml auto-generate with -uuid * Add endpoint for health check and change endpoint * refact(cmd): refactor flag set * fix(report): enable to specify opts with cmd arg and env value * fix(scan): enable to parse the release version of amazon linux 2 * add(report) add -to-saas option (#695) * add(report) add -to-saas option * ignore other writer if -to-saas * fix(saas) fix bug * fix(scan): need-restarting needs internet connection * fix(scan,configtest): check scan mode * refactor(scan): change func name * fix(suse): support offline mode, bug fix on AWS, zypper --no-color * fix(tui): fix nil pointer when no vulns in tui * feat(report): enable to define CPE FS format in config.toml * fix(vet): fix warnings of go vet * fix(travis): go version to 1.11 * update deps
		
			
				
	
	
		
			349 lines
		
	
	
		
			8.6 KiB
		
	
	
	
		
			Go
		
	
	
	
	
	
			
		
		
	
	
			349 lines
		
	
	
		
			8.6 KiB
		
	
	
	
		
			Go
		
	
	
	
	
	
/* Vuls - Vulnerability Scanner
 | 
						|
Copyright (C) 2016  Future Corporation , Japan.
 | 
						|
 | 
						|
This program is free software: you can redistribute it and/or modify
 | 
						|
it under the terms of the GNU General Public License as published by
 | 
						|
the Free Software Foundation, either version 3 of the License, or
 | 
						|
(at your option) any later version.
 | 
						|
 | 
						|
This program is distributed in the hope that it will be useful,
 | 
						|
but WITHOUT ANY WARRANTY; without even the implied warranty of
 | 
						|
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
 | 
						|
GNU General Public License for more details.
 | 
						|
 | 
						|
You should have received a copy of the GNU General Public License
 | 
						|
along with this program.  If not, see <http://www.gnu.org/licenses/>.
 | 
						|
*/
 | 
						|
 | 
						|
package scan
 | 
						|
 | 
						|
import (
 | 
						|
	"fmt"
 | 
						|
	"net"
 | 
						|
	"strings"
 | 
						|
 | 
						|
	"github.com/future-architect/vuls/config"
 | 
						|
	"github.com/future-architect/vuls/models"
 | 
						|
	"github.com/future-architect/vuls/util"
 | 
						|
)
 | 
						|
 | 
						|
// inherit OsTypeInterface
 | 
						|
type bsd struct {
 | 
						|
	base
 | 
						|
}
 | 
						|
 | 
						|
// NewBSD constructor
 | 
						|
func newBsd(c config.ServerInfo) *bsd {
 | 
						|
	d := &bsd{
 | 
						|
		base: base{
 | 
						|
			osPackages: osPackages{
 | 
						|
				Packages:  models.Packages{},
 | 
						|
				VulnInfos: models.VulnInfos{},
 | 
						|
			},
 | 
						|
		},
 | 
						|
	}
 | 
						|
	d.log = util.NewCustomLogger(c)
 | 
						|
	d.setServerInfo(c)
 | 
						|
	return d
 | 
						|
}
 | 
						|
 | 
						|
//https://github.com/mizzy/specinfra/blob/master/lib/specinfra/helper/detect_os/freebsd.rb
 | 
						|
func detectFreebsd(c config.ServerInfo) (itsMe bool, bsd osTypeInterface) {
 | 
						|
	bsd = newBsd(c)
 | 
						|
 | 
						|
	// Prevent from adding `set -o pipefail` option
 | 
						|
	c.Distro = config.Distro{Family: config.FreeBSD}
 | 
						|
 | 
						|
	if r := exec(c, "uname", noSudo); r.isSuccess() {
 | 
						|
		if strings.Contains(strings.ToLower(r.Stdout), config.FreeBSD) == true {
 | 
						|
			if b := exec(c, "freebsd-version", noSudo); b.isSuccess() {
 | 
						|
				rel := strings.TrimSpace(b.Stdout)
 | 
						|
				bsd.setDistro(config.FreeBSD, rel)
 | 
						|
				return true, bsd
 | 
						|
			}
 | 
						|
		}
 | 
						|
	}
 | 
						|
	util.Log.Debugf("Not FreeBSD. servernam: %s", c.ServerName)
 | 
						|
	return false, bsd
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) checkScanMode() error {
 | 
						|
	if o.getServerInfo().Mode.IsOffline() {
 | 
						|
		return fmt.Errorf("Remove offline scan mode, FreeBSD needs internet connection")
 | 
						|
	}
 | 
						|
	return nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) checkIfSudoNoPasswd() error {
 | 
						|
	// FreeBSD doesn't need root privilege
 | 
						|
	o.log.Infof("sudo ... No need")
 | 
						|
	return nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) checkDeps() error {
 | 
						|
	o.log.Infof("Dependencies... No need")
 | 
						|
	return nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) preCure() error {
 | 
						|
	o.log.Infof("Scanning in %s", o.getServerInfo().Mode)
 | 
						|
	if err := o.detectIPAddr(); err != nil {
 | 
						|
		o.log.Debugf("Failed to detect IP addresses: %s", err)
 | 
						|
	}
 | 
						|
	// Ignore this error as it just failed to detect the IP addresses
 | 
						|
	return nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) postScan() error {
 | 
						|
	return nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) detectIPAddr() (err error) {
 | 
						|
	r := o.exec("/sbin/ifconfig", noSudo)
 | 
						|
	if !r.isSuccess() {
 | 
						|
		return fmt.Errorf("Failed to detect IP address: %v", r)
 | 
						|
	}
 | 
						|
	o.ServerInfo.IPv4Addrs, o.ServerInfo.IPv6Addrs = o.parseIfconfig(r.Stdout)
 | 
						|
	return nil
 | 
						|
}
 | 
						|
 | 
						|
func (l *base) parseIfconfig(stdout string) (ipv4Addrs []string, ipv6Addrs []string) {
 | 
						|
	lines := strings.Split(stdout, "\n")
 | 
						|
	for _, line := range lines {
 | 
						|
		line = strings.TrimSpace(line)
 | 
						|
		fields := strings.Fields(line)
 | 
						|
		if len(fields) < 4 || !strings.HasPrefix(fields[0], "inet") {
 | 
						|
			continue
 | 
						|
		}
 | 
						|
		ip := net.ParseIP(fields[1])
 | 
						|
		if ip == nil {
 | 
						|
			continue
 | 
						|
		}
 | 
						|
		if !ip.IsGlobalUnicast() {
 | 
						|
			continue
 | 
						|
		}
 | 
						|
		if ipv4 := ip.To4(); ipv4 != nil {
 | 
						|
			ipv4Addrs = append(ipv4Addrs, ipv4.String())
 | 
						|
		} else {
 | 
						|
			ipv6Addrs = append(ipv6Addrs, ip.String())
 | 
						|
		}
 | 
						|
	}
 | 
						|
	return
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) scanPackages() error {
 | 
						|
	// collect the running kernel information
 | 
						|
	release, version, err := o.runningKernel()
 | 
						|
	if err != nil {
 | 
						|
		o.log.Errorf("Failed to scan the running kernel version: %s", err)
 | 
						|
		return err
 | 
						|
	}
 | 
						|
	o.Kernel = models.Kernel{
 | 
						|
		Release: release,
 | 
						|
		Version: version,
 | 
						|
	}
 | 
						|
 | 
						|
	rebootRequired, err := o.rebootRequired()
 | 
						|
	if err != nil {
 | 
						|
		o.log.Errorf("Failed to detect the kernel reboot required: %s", err)
 | 
						|
		return err
 | 
						|
	}
 | 
						|
	o.Kernel.RebootRequired = rebootRequired
 | 
						|
 | 
						|
	packs, err := o.scanInstalledPackages()
 | 
						|
	if err != nil {
 | 
						|
		o.log.Errorf("Failed to scan installed packages: %s", err)
 | 
						|
		return err
 | 
						|
	}
 | 
						|
	o.Packages = packs
 | 
						|
 | 
						|
	unsecures, err := o.scanUnsecurePackages()
 | 
						|
	if err != nil {
 | 
						|
		o.log.Errorf("Failed to scan vulnerable packages: %s", err)
 | 
						|
		return err
 | 
						|
	}
 | 
						|
	o.VulnInfos = unsecures
 | 
						|
	return nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) parseInstalledPackages(string) (models.Packages, models.SrcPackages, error) {
 | 
						|
	return nil, nil, nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) rebootRequired() (bool, error) {
 | 
						|
	r := o.exec("freebsd-version -k", noSudo)
 | 
						|
	if !r.isSuccess() {
 | 
						|
		return false, fmt.Errorf("Failed to SSH: %s", r)
 | 
						|
	}
 | 
						|
	return o.Kernel.Release != strings.TrimSpace(r.Stdout), nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) scanInstalledPackages() (models.Packages, error) {
 | 
						|
	cmd := util.PrependProxyEnv("pkg version -v")
 | 
						|
	r := o.exec(cmd, noSudo)
 | 
						|
	if !r.isSuccess() {
 | 
						|
		return nil, fmt.Errorf("Failed to SSH: %s", r)
 | 
						|
	}
 | 
						|
	return o.parsePkgVersion(r.Stdout), nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) scanUnsecurePackages() (models.VulnInfos, error) {
 | 
						|
	const vulndbPath = "/tmp/vuln.db"
 | 
						|
	cmd := "rm -f " + vulndbPath
 | 
						|
	r := o.exec(cmd, noSudo)
 | 
						|
	if !r.isSuccess(0) {
 | 
						|
		return nil, fmt.Errorf("Failed to SSH: %s", r)
 | 
						|
	}
 | 
						|
 | 
						|
	cmd = util.PrependProxyEnv("pkg audit -F -r -f " + vulndbPath)
 | 
						|
	r = o.exec(cmd, noSudo)
 | 
						|
	if !r.isSuccess(0, 1) {
 | 
						|
		return nil, fmt.Errorf("Failed to SSH: %s", r)
 | 
						|
	}
 | 
						|
	if r.ExitStatus == 0 {
 | 
						|
		// no vulnerabilities
 | 
						|
		return nil, nil
 | 
						|
	}
 | 
						|
 | 
						|
	var packAdtRslt []pkgAuditResult
 | 
						|
	blocks := o.splitIntoBlocks(r.Stdout)
 | 
						|
	for _, b := range blocks {
 | 
						|
		name, cveIDs, vulnID := o.parseBlock(b)
 | 
						|
		if len(cveIDs) == 0 {
 | 
						|
			continue
 | 
						|
		}
 | 
						|
		pack, found := o.Packages[name]
 | 
						|
		if !found {
 | 
						|
			return nil, fmt.Errorf("Vulnerable package: %s is not found", name)
 | 
						|
		}
 | 
						|
		packAdtRslt = append(packAdtRslt, pkgAuditResult{
 | 
						|
			pack: pack,
 | 
						|
			vulnIDCveIDs: vulnIDCveIDs{
 | 
						|
				vulnID: vulnID,
 | 
						|
				cveIDs: cveIDs,
 | 
						|
			},
 | 
						|
		})
 | 
						|
	}
 | 
						|
 | 
						|
	// { CVE ID: []pkgAuditResult }
 | 
						|
	cveIDAdtMap := make(map[string][]pkgAuditResult)
 | 
						|
	for _, p := range packAdtRslt {
 | 
						|
		for _, cid := range p.vulnIDCveIDs.cveIDs {
 | 
						|
			cveIDAdtMap[cid] = append(cveIDAdtMap[cid], p)
 | 
						|
		}
 | 
						|
	}
 | 
						|
 | 
						|
	vinfos := models.VulnInfos{}
 | 
						|
	for cveID := range cveIDAdtMap {
 | 
						|
		packs := models.Packages{}
 | 
						|
		for _, r := range cveIDAdtMap[cveID] {
 | 
						|
			packs[r.pack.Name] = r.pack
 | 
						|
		}
 | 
						|
 | 
						|
		disAdvs := []models.DistroAdvisory{}
 | 
						|
		for _, r := range cveIDAdtMap[cveID] {
 | 
						|
			disAdvs = append(disAdvs, models.DistroAdvisory{
 | 
						|
				AdvisoryID: r.vulnIDCveIDs.vulnID,
 | 
						|
			})
 | 
						|
		}
 | 
						|
 | 
						|
		affected := models.PackageStatuses{}
 | 
						|
		for name := range packs {
 | 
						|
			affected = append(affected, models.PackageStatus{
 | 
						|
				Name: name,
 | 
						|
			})
 | 
						|
		}
 | 
						|
		vinfos[cveID] = models.VulnInfo{
 | 
						|
			CveID:            cveID,
 | 
						|
			AffectedPackages: affected,
 | 
						|
			DistroAdvisories: disAdvs,
 | 
						|
			Confidences:      models.Confidences{models.PkgAuditMatch},
 | 
						|
		}
 | 
						|
	}
 | 
						|
	return vinfos, nil
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) parsePkgVersion(stdout string) models.Packages {
 | 
						|
	packs := models.Packages{}
 | 
						|
	lines := strings.Split(stdout, "\n")
 | 
						|
	for _, l := range lines {
 | 
						|
		fields := strings.Fields(l)
 | 
						|
		if len(fields) < 2 {
 | 
						|
			continue
 | 
						|
		}
 | 
						|
 | 
						|
		packVer := fields[0]
 | 
						|
		splitted := strings.Split(packVer, "-")
 | 
						|
		ver := splitted[len(splitted)-1]
 | 
						|
		name := strings.Join(splitted[:len(splitted)-1], "-")
 | 
						|
 | 
						|
		switch fields[1] {
 | 
						|
		case "?", "=":
 | 
						|
			packs[name] = models.Package{
 | 
						|
				Name:    name,
 | 
						|
				Version: ver,
 | 
						|
			}
 | 
						|
		case "<":
 | 
						|
			candidate := strings.TrimSuffix(fields[6], ")")
 | 
						|
			packs[name] = models.Package{
 | 
						|
				Name:       name,
 | 
						|
				Version:    ver,
 | 
						|
				NewVersion: candidate,
 | 
						|
			}
 | 
						|
		case ">":
 | 
						|
			o.log.Warnf("The installed version of the %s is newer than the current version. *This situation can arise with an out of date index file, or when testing new ports.*", name)
 | 
						|
			packs[name] = models.Package{
 | 
						|
				Name:    name,
 | 
						|
				Version: ver,
 | 
						|
			}
 | 
						|
		}
 | 
						|
	}
 | 
						|
	return packs
 | 
						|
}
 | 
						|
 | 
						|
type vulnIDCveIDs struct {
 | 
						|
	vulnID string
 | 
						|
	cveIDs []string
 | 
						|
}
 | 
						|
 | 
						|
type pkgAuditResult struct {
 | 
						|
	pack         models.Package
 | 
						|
	vulnIDCveIDs vulnIDCveIDs
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) splitIntoBlocks(stdout string) (blocks []string) {
 | 
						|
	lines := strings.Split(stdout, "\n")
 | 
						|
	block := []string{}
 | 
						|
	for _, l := range lines {
 | 
						|
		if len(strings.TrimSpace(l)) == 0 {
 | 
						|
			if 0 < len(block) {
 | 
						|
				blocks = append(blocks, strings.Join(block, "\n"))
 | 
						|
				block = []string{}
 | 
						|
			}
 | 
						|
			continue
 | 
						|
		}
 | 
						|
		block = append(block, strings.TrimSpace(l))
 | 
						|
	}
 | 
						|
	if 0 < len(block) {
 | 
						|
		blocks = append(blocks, strings.Join(block, "\n"))
 | 
						|
	}
 | 
						|
	return
 | 
						|
}
 | 
						|
 | 
						|
func (o *bsd) parseBlock(block string) (packName string, cveIDs []string, vulnID string) {
 | 
						|
	lines := strings.Split(block, "\n")
 | 
						|
	for _, l := range lines {
 | 
						|
		if strings.HasSuffix(l, " is vulnerable:") {
 | 
						|
			packVer := strings.Fields(l)[0]
 | 
						|
			splitted := strings.Split(packVer, "-")
 | 
						|
			packName = strings.Join(splitted[:len(splitted)-1], "-")
 | 
						|
		} else if strings.HasPrefix(l, "CVE:") {
 | 
						|
			cveIDs = append(cveIDs, strings.Fields(l)[1])
 | 
						|
		} else if strings.HasPrefix(l, "WWW:") {
 | 
						|
			splitted := strings.Split(l, "/")
 | 
						|
			vulnID = strings.TrimSuffix(splitted[len(splitted)-1], ".html")
 | 
						|
		}
 | 
						|
	}
 | 
						|
	return
 | 
						|
}
 |